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ABSTRACT 


Dynamically  interactive  systems  are  characterized  by  a 
mutual  interaction  in  which  each  of  the  systems  responds  to 
each  of  the  other  systems  according  to  its  perception  of 
the  problem  and  its  perceived  methods  of  achieving  a goal  or 
objective.  Examples  of  the  problem  class  are: 

• Aircraft  collision  avoidance 

• Destroyer/Submarine  Encounter 

• Air  Combat 

• The  Child's  Game  of  Tag 

The  analysis  of  dynamically  interactive  systems  is 
approached  from  a non-deterministic  viewpoint.^ This  relaxes 
the  more  traditional  assumptions  of  perfect  information  and 
perfect  response  and  allows  for  adaptation  responses  not 
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normally  included  in  such  analyses.  The  analysis  is  applied 
directly  to  experimental  data.  Traditional  statistical 
descriptors  of  the  interaction  outcomes  may  be  supplemented 
by  statements  about  the  form  and  substance  of  the  interaction. 
In  order  to  analyze  the  system  interaction,  the  problem  must 
first  be  defined  in  terms  of  its  history,  goals,  and 
priorities.  Secondly,  the  process  of  merit  ordering  is 
undertaken  to  define  a f igure-of-merit  to  be  used  as  the 
primary  analysis  parameter.  Next,  the  definition  of  applicable 
mathematical  and  statistical  tools  is  required.  Detailed 
numerical  analysis  of  the  problem  is  undertaken  using  the 
mathematical  and  statistical  tools,  and  the  defined  f igure- 
of-merit  as  it  relates  to  the  problem.  Finally,  the  develop- 
ment of  measures  of  effectiveness  which  adequately  reflect 
the  form  and  substance  of  the  interaction  is  undertaken. 
Detailed  numerical  procedures  are  presented  for  a given 
example  of  the  problem  class,  together  with  comparisons  to 
previously  derived  analysis  variables  and  previously  defined 
measures-of-effectiveness.  Examples  of  conclusions  and 
recommendations  together  with  sensitivity  analyses  are 
presented.  Certain  of  these  measures  have  been  independently 
verified,  but  other  measures  are  not  available  by  alternative 
analysis  methods. 
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CHAPTER  1 
INTRODUCTION 

"A  little  bit  of  competence  is  worth  a whole  lot  of 
confidence . " --  R.  Jeneon 

(Texas  A&M  University ) 

The  problem  of  the  interaction  of  two  systems  has  been 
adequately  approached  only  when  severe  restrictions  are 
placed  on  the  problem  formulation.  These  restrictions  may 
take  many  forms;  for  example,  in  a two-body  collision  (the 
billiard  ball  model),  it  is  assumed  that  system  A (a  bil- 
liard ball)  is  unaware  of  system  B (A  billiard  ball)  until 
collision,  and  the  response  is  governed  by  a set  of  deter- 
ministic requirements.  Or,  the  assumption  that  system  A is 
unaware  may  be  relaxed,  and  its  response  can  again  be  formu- 
lated but  as  governed  by  a set  of  deterministic  responses  to 
system  B's  presence,  and  finally  a collision  (or  near. colli- 
sion) response.  The  assumptions  can  be  further  relaxed  until 
the  response  of  system  A to  system  B becomes  very  complicated 
and  indeed  may  be  mathematically  unsolveable.  The  over- 
riding and  most  decisive  assumption  in  the  entire  analysis 
is  that  if  the  mechanism  of  encounter  is  known  (no  matter  how 
complex) , then  the  interaction  can  be  computed.  In  short, 
system  B will  respond  to  an  interaction  with  system  A. -and 
every  similar  interaction  with  system  A with  a "given" 
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response.  The  response  of  system  B is  a function  only  of  , 

the  state  of  the  universe  at  some  time  zero  and  its  inter- 
action is  governed  by  physical  laws  (known  or  unknown) . .The 
response  of  system  B is  deterministic.  This  approach  to  a 
very  large  class  of  problems  presents  no  difficulties  and 
the  deterministic  assumption  is  valid. 

There  exists,  however,  a class  of  problems  for  which 
the  deterministic  assumption  can  be  demonstrated  to  be  in- 
valid. Such  problems  can  generally  be  classed  as  including 

t 

a variant  not  well  defined  mathematically.  Such  a variant 
might  be  the  reaction  of  a human  operator,  or  sunspot 
activity,  or  hardware  failure  rates.  Very  often,  experi- 
mental data  will  give  varying  responses  no  matter  how  closely 
the  experimental  variables  are  controlled. 

The  classical  approach  to  the  solution  to  the  problem 
has  been  two-fold.  The  first  approach  advanced  by  statis- 
ticians and  operational  analysts  is  a statistical  formula- 
tion of  the  controlling  variables  (such  as  mean  time  between 

> 

failures)  and  an  expectation  of  response  based  on  a statis- 
tical description  of  the  problem  variables,  thus  giving  a 
range  of  expected  results  with  or  without  statistical  weights. 

Such  problem  formulations  and  their  solutions  are  discussed 
in  detail  by  Box  and  Jenkins,  or  Bryson  and  Ho.  (See 
references  1 & 2.) 


The  second  approach  advanced  primarily  by  mathemati-  > 

cians  and  control  systems  analysts  is  a cybernetic  approach 
and  sought  to  control  the  interaction  by  adaptive  response 
of  one  of  the  systems  to  the  developing  situation.  The 
problematical  approach  arose  in  the  air  gunnery  problem  where 
the  speed  of  the  aircraft  became  a significant  portion  of 
the  gunnery  projectile  as  described  by  Wiener  (see  refer- 
ence 3) , and  it  became  necessary  to  aim  the  guns  not  at  the 
aircraft,  but  at  where  the  aircraft  will  be  at  the  arrival 
of  the  projectile.  In  these  formulations  the  control  feed- 
back is  often  a function  of  the  perceived  system  response. 

These  methods  are  further  developed  by  Bellman  (see  refer- 
ence 4) . 

Figure  (1)  shows  the  basic  problem  formulation.  Two 
systems  (A  and  B)  are  involved  in  an  interaction  situation. 

Each  system  has  some  vantage  (often  referred  to  as  informa- 
tion) through  which  it  may  interpret  the  situation.  The 
interpretation  is  then  matched  against  certain  objectives 
and  how  to  achieve  these  objectives  in  a given  situation 
(including  external  inputs  such  as  doctrine) . An  intended 
response  is  computed  (arrived  at  by  some  means) , this  response 
is  attempted  through  some  control  mechanism  and  this  feeds 
back  to  the  system  vantage  for  further  interpretation.  To 
this  point  we  have  a standard  control  system  formulation,  but 
two  additional  aspects  of  the  real  problem  need  be  considered. 


EXAMPLES:  AIRCRAFT  COLLISION  AVOIDANCE 
DESTROYER/SUBMARINE  FIGHT 
AIR  COMBAT 
CHESS 
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Each  system,  through  its  interpretation  of  the  problem  may 
alter  its  objectives.  Additionally,  based  on  experience  it 
may  alter  its  interpretation  of  the  situation.  The  last  .two 
feedback  loops  are  the  adaptive  ones  and  make  the  problem 
both  non-stationary  and  non-linear.  As  a simple  example, 
one  can  use  the  environmental  control  problem.  A thermostat 
controls  both  a heater  and  an  air  conditioner.  The  object 
of  the  interaction  of  system  A (the  environmental  control 
system)  with  system  B (the  environment)  is  temperature  main- 
tenance. It  is  significant  to  the  problem  that  this  objec- 
tive is  attached  to  system  A and  that  system  B is  passive 
(no  objective  or  counter  objective) . There  is  neither 


perfect  information  (vantage/interpretation)  or  control 
(response  mechanism) . The  system  measures  temperatures 
imperfectly,  and  it  controls  its  apparatus  with  some  lag 

(i.e.,  when  the  temp  rises  to  that  required,  the  furnace  is 

■ 

hot  and  burning,  a shutdown  here  wastes  fuel  and  will 
probably  cause  a temperature  overshoot) . 

Both  types  of  solutions  to  this  control  problem  have 
been  successfully  employed.  In  the  statistical  approach, 
the  measurement  errors  are  statistically  modeled.  Some 
temperature  lower  than  desired  is  used  to  initiate  the 
furnace  and  •some  temperature  higher  than  desired  is  used  to 
initiate  the  air  conditioner,  both  cease  when  the  desired 
temperature  is  obtained.  In  the  cybernetic  approach,  the 
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rate  of  change  of  temperature  can  be  used  to  determine  the 
level  of  furnace  activity  (such  as  replacing  BTU's  lost). 

The  problem  may  be  further  complicated  by  making  the  environ- 
ment active  with  compatible  or  uncompatible  objectives  as  in 
the  case  of  a second  unseen  environmental  control  system  with 
the  same  or  different  objectives. 

This  paper  will  concern  itself  with  the  more  compli- 
cated of  these  interactions,  and  a strictly  analysis  of 
experimental  data  (as  opposed  to  a control)  view  of  the 
operational  aspects  of  such  interactions.  The  emphasis  will 
be  on  the  tactics  and  strategies  of  such  interactions  and  a 
measure  of  the  expected  outcomes  of  such  encounters. 

Problems  that  fall  into  the  class  to  be  discussed 
include: 

• The  aircraft  collision  avoidance  problem- 
where  systems  A and  B are  represented  by  air- 
planes and  the  objectives  of  both  are  to  avoid 
collision. 

• The  Anti-Submarine  Warfare  (ASW)  encounter 
between  the  Destroyer  or  Destroyers  (system  A) 
and  the  Submarine  or  Submarines  (system  B) . 

Whose  objectives  in  each  case  are:  (1)  survival 
and  (2)  destruction  of  the  opposing  system. 
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• The  Air  Combat  Maneuvering  (ACM)  encounter 
where  the  systems  are  represented  by  airplane  or 
airplanes  and  the  objectives  in  each  case  are: 

(1)  survival  and  (2)  destruction  of  the  opposing 
system. 

• The  child's  game  of  tag,  where  system  A (the 
child  who  is  it)  has  the  objective  of  placing 
the  tag,  and  systems  B,  C,  D,  etc.  (other 
children)  have  the  objective  of  avoiding  the  tag. 
Note  that  other  children  in  the  game  do  not  act 
cooperatively,  but  act  as  independent  systems. 

• The  air-to-ground  encounter  where  system  A is 
an  airplane  or  airplanes  and  system  B is  an  anti- 
aircraft sight.  The  objectives  in  each  case  are: 
(.1)  survival  and  (2)  destruction  of  the  opposing 
system. 

Each  of  these  interaction  problems  is  characterized  by  imper- 
fect information  and  adaptive  feedback  mechanisms.  They  also 
embody  the  ability  to  reorder  the  priority  and  even  the 
structure  of  objectives  depending  on  the  situation  at  hand. 

The  number  of  degrees  of  freedom  embodied  in  the  data 
limit  the  ability  to  directly  analyze  the  vast  majority  of 
these  problems  due  to  lack  of  an  adequate  data  operation 
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capability.  The  armed  services,  however,  have  recently  built 
and  begun  using  ranges  which  are  fully  capable  of  documenting 
the  time  interaction  of  air  combat  with  multiple  aircraft 
(up  to  4 by  4).  Such  a capability  provides  the  data  needed 


for  these  analyses  and,  therefore,  the  remainder  of  this 
paper  will  be  limited  to  the  analysis  of  air  combat  data. 


CHAPTER  2 


M- 


BACKGROUND 

"Experiments  are  the  only  means  of  knowledge  at  our  disposal . 

The  rest  is  poetry,  imagination. " --  Max  Planok 

Nunn  and  Oberle  (reference  5)  have  highlighted  the 
evolution  of  air  combat.  That  history  has  been  adapted  with 
permission  of  the  authors.  It  has  been  modified  and  ex- 
tended for  use  here. 

EVOLUTION  OF  AIR  COMBAT 

Air-to-air  combat  had  its  origin  in  World  War  I.  It 
resulted  from  an  attempt  to  counter  the  use  of  aircraft  for 
tactical  aerial  reconnaissance.  The  early  fighters  were 
two-place  aircraft  armed  with  a machine  gun  mounted  in  the 
rear  seat.  The  initial  employment  tactics  consisted  of  Y* 

flying  in  front  of  the  unarmed  reconnaissance  plane  and 
firing  toward  the  rear.  In  an  attempt  to  counter  this  tactic, 
a forward  firing  machine  gun  was  developed  to  be  mounted  on 
the  reconnaissance  aircraft. 

The  first  engagement  between  a reconnaissance  aircraft 
with  a forward  firing  weapon  and  a reconnaissance  aircraft 
with  only  a rearward  firing  weapon  took  place  in  October  of 
1914  over  Belgium  (reference  6) . A French  Voisin  (pusher 
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propeller)  had  been  equipped  with  a Hotchkiss  semi-automatic 
machine  gun  mounted  on  a pylon  arrangement  over  the  pilot's 
head  which  the  observer  fired.  A German  Aviatik  was 
heading  back  toward  the  German  lines  after  tactical  recon- 
naissance. The  engagement  was  brief  but  decisive.  Although 
the  two-seat  German  aircraft  was  armed  with  a rear-mounted 
gun,  the  French  aircraft  stayed  low  behind  the  Aviatik  and 
the  German  plane's  field  of  fire  was  blanked  by  its  own  tail 
and  fuselage. 

The  German's  subsequently  developed  a forward  firing 
weapon  which  would  fire  through  the  propeller  of  an  airplane 
with  the  engine  in  the  nose.  Shortly  thereafter,  allied  re- 
connaissance aircraft  were  similarly  armed.  This  techno- 
logical advance  not  only  changed  the  defensive  capability  of 
the  reconnaissance  aircraft,  but  actually  gave  birth  to  what 
is  known  as  classical  air  combat  maneuvering  (ACM) . 

The  introduction  of  the  forward-firing  weapon  dras- 
tically altered  the  nature  of  the  aerial  combat.  Rather 
than  flying  in  front  of  the  opponent  and  firing  to  the  rear, 
pilots  attempted  to  achieve  a position  in  the  opponent's  rear 
hemisphere  before  firing.  As  the  opponent  was  rarely  coopera- 
tive, highly  dynamic  pursuit/evader  maneuvering  ensued. 
Aircrews  very  appropriately  named  such  an  engagement  a "dog- 
fight." Very  early  in  the  evolution  of  this  dynamic  air 
combat,  referred  to  as  ACM,  fighter  aircrews  recognized  the 
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need  to  be  cautious  because  of  the  fighter's  vulnerability 
to  attack  by  other  opposition  aircraft  while  concentrating 
on  a single  opponent.  This  caution  resulted  in  the  develop- 
ment of  various  flight  formations  and  engagement  tactics 
designed  to  provide  an  aggressive  capability  without 
compromising  the  required  lookout  for  other  enemy  fighters. 

The  principles  that  balanced  aggression  and  caution  have 
remained  unchanged  in  both  character  and  importance  to  this 

day.  1 

J 

Throughout  World  War  II  and  the  Korean  conflict,  the  1 

nature  of  ACM  remained  essentially  unchanged.  More  sophis-  < 

ticated  gun  systems  and  more  powerful  aircraft  were  intro-  j 

1 j 

duced,  but  the  basic  maneuvering  characteristics  of  the  ACM 
engagement  remained.  Throughout  these  conflicts,  aircrews 

adjusted  engagement  tactics  fo  fit  changing  tactical  situa-  < 

. > 

tions  and  continually  relearned  the  well-known  tactical 

lesson — you  never  see  the  one  that  defeats  you.  j 

World  War  II  did  generate  a new  fighter  mission — the 
fighter  interceptor.  In  this  role,  the  high-speed,  well- 
armed  fighter  aircraft  were  vectored  to  intercept  and  engage 
the  heavy  bomber  as  it  proceeded  to  its  target.  Engagements 
of  this  type  were  generally  characterized  by  high-speed 
fighter  firing  passes  with  some  evasive  maneuvering  to  avoid 
the  bomber  gun  defenses.  In  the  interceptor  role,  the 
forward  firing  weapons  of  the  fighter  were  countered  by 
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trainable  weapons  on  the  bombers.  The  trainable  weapons 
were  defensive  weapons  while  the  forward  firing  weapon  was 
the  offensive  weapon. 

In  the  mid-1950s,  the  air-to-air  guided  missile 
appeared  in  the  fighter  armament  inventory.  Although  both 
radar-guided  and  heat-seeking  varieties  were  available,  the 
heat-seeking  missile  represented  the  technological  break- 
through which  most  strongly  affected  the  ACM  engagement. 
Although  the  radar-guided  missile  was  conceptually  an  all- 
aspect weapon,  the  difficulty  in  maintaining  radar  track  on 
a maneuvering  opponent  greatly  diminished  the  effectiveness 
of  this  missile  in  the  classical  ACM  role,  and  the  radar- 
guided  missile  was  relegated  to  use  in  the  interceptor  role. 

The  heat-seeking  missile,  on  the  other  hand,  had  the 
very  desirable  characteristic  of  pursuing  the  target  after 
launch,  independent  of  postlaunch  maneuvers  of  the  firing  air- 
craft. This  significantly  decreased  the  vulnerability  of  the 
firing  aircraft  during  the  weapons-f iring  portion  of  the 
engagement.  As  with  gun  systems,  the  early  heat-seeking 
missiles  were  effective  only  when  fired  in  the  opponent's 
rear  hemisphere.  Again,  the  major  technological  advance 
failed  to  alter  the  dynamic  maneuvering  nature  of  ACM. 

By  the  early  1960s,  the  role  of  the  pure  fighter  had 
essentially  been  replaced  by  the  dual-mission  fighter  inter- 
ceptor. Armed  with  both  radar  and  infrared  (heat-seeking) 
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guided  missiles,  the  fighter  interceptor  was  prepared  for 
either  mission.  This  seperation  of  function — radar-guided 
weapons  for  head-on,  closing  shots  and  heat-seeking  missiles 
and  guns  for  the  ACM  engagements — continued  into  the  1970s. 

In  these  latter  years,  widespread  use  of  the  digital  i 

computer  and  the  development  of  usable  rapid  lock-on  modes 
of  radar  operation  significantly  increased  the  usefulness  of 
radar-guided  missiles  in  ACM  engagements.  Simultaneously,  1 

breakthroughs  in  seeker  sensitivity  resulted  in  heat-seeking  I 

missiles  with  some  capability  in  an  opponent's  forward  i 

hemisphere.  Current  fighter  interceptor  aircraft  are  armed 
with  a mix  of  weapons,  each  type  useful  in  either  kind  of 

1 

engagement.  It  should  be  noted  that  all  of  the  current 

fighter  aircraft  have  only  forward  firing  weapons,  while 

several  of  the  bomber  aircraft  (Soviet  and  U.S.)  have  rear-  ( 

ward  firing  weapons.  The  forward  firing  weapon  is  inherently 

offensive,  while  the  rearward  firing  weapon  is  inherently 

defensive.  ; 

As  the  pure  fighter  was  replaced  by  the  dual-mission 
fighter  interceptor,  aircrews  trained  for  perfection  in  both 
roles.  The  training  engagement  generally  consisted  of  a 
forward  quarter  simulated  intercept  during  which  weapons  would 

I 1 

be  employed,  followed  by  an  ACM  engagement  after  the  initial 
pass.  During  each  portion  of  the  engagement  simulated 
missiles  are  launched  and  defensive  maneuvers  evaluated.  In 
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the  interceptor  role,  success  can  be  equated  with  the  ability 

to  set-up  and  launch  forward-hemisphere  weapons,  counter 

opponent  firings,  and  prepare  for  ACM.  In  the  ACM  role, 

success  is  equated  with  maneuvering  effectiveness  and  visual 

information,  i.e.,  the  fighter  crew  must  maintain  a clear  ‘ 

picture  of  the  constantly  changing  tactical  situation,  out- 

maneuver  the  opponent,  obtain  a position  in  the  opponent's  \ 

rear  hemisphere,  and  fire  weapons.  The  development  of 

methods  to  evaluate  the  total  system  (aircraft,  aircrew,  ! 

weapon  system,  and  tactics)  in  these  training  flights  has 
been  a goal  that  has  eluded  combat  analysts  for  the  entire 
history  of  aerial  combat.  ( 

While  the  underlying  principles  have  remained  essen- 
tially unchanged,  the  enlargement  of  the  basic  fighter 
mission,  the  increase  in  aircrew  workload,  and  the  demands 
of  coordination  and  timing  have  drastically  altered  air  com- 
bat training  requirements.  Experience  in  both  Southeast  Asia 
and  the  Arab/Israeli  conflicts,  reemphasized  the  need  for  i 

continual,  comprehensive  aircrew  training.  These  training 
demands  stimulated  the  development  of  instrumented  ranges 
for  the  required  routine  air  combat  training.  Developed  on 
the  principle  that  "seeing  is  believing,"  these  ranges  permit 

| 

aircrews  to  review  training  engagements  to  isolate  mistakes, 
evaluate  weapon  firings,  and  discuss  tactical  achievements 
and  deficiencies.  These  ranges  are  described  in  detail  later 
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in  this  chapter.  The  training  potential  of  these  ranges  will 
take  years  to  exploit.  The  model  in  this  study  is  designed 
to  contribute  to  this  exploitation. 

AIR  COMBAT  EVALUATION  TECHNIQUES 

The  development  of  methodologies  for  evaluating  air-to- 
air  engagement  has  proceeded  along  two  lines.  One  approach 
has  been  to  analyze  the  maneuver  dynamics  of  two  engaging  air- 
craft. Such  models  are  based  on  physical  principles  and 
have  been  used  to  improve  airframe  design,  drive  manned 
simulations,  and  assist  in  postulating  engagement  tactics. 
Postulated  tactics  were  then  flight  tested  often  with  un- 
expected results.  The  second  modeling  approach  is  event 
oriented  and  consists  of  formulating  simple  measures  of 
effectiveness  of  the  various  elements  (aircraft,  weapon  sys- 
tem, tactic,  etc.)  of  ACM  engagements,  and  computing  these 
measures  with  the  data  gathered  at  a test  range. 
Energy-Maneuverability  Models 

These  models  are  used  to  analyze  the  maneuver  dynamics 
and  have  been  the  most  successful  for  ACM  analysis.  The 
basic  ideas  of  energy  maneuverability  (Boyd  and  Christie) 
have  been  extended  using  variational  and  differential  gaming 
techniques  to  determine  optimal  maneuver  tactics.  This 
methodology  uses  the  physical  equations  of  motion  to  relate 
the  effects  of  accelerated  flight  on  system  energy  (E  ) and 
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rate  of  change  of  energy  (Pg) . It  has  been  used  to  design 
maneuver  tactics  based  on  energy .management  (an  obscure  term 
meaning  do  things  the  way  that  aerodynamics  allows  most 
easily)  and  to  identify  flight  regimes  where  fighter  airframe 
performance  exceeds  that  of  a postulated  opponent.  The 
methodology  also  helps  a pilot  understand  the  limits  and 
potential  performance  of  opposing  aircraft.  The  latter  is 
of  signal  importance  because  actual  practice  with  opposition 
aircraft  is  seldom  available.  With  this  methodology,  effi- 
cient energy  management  may  be  derived  which  maximizes  the 
number  of  maneuver  options  within  the  limits  of  the  airframe. 

This  use  of  energy-maneuverability  theory  is  sometimes  called 
the  maximum  maneuver  concept  and  results  in  the  tactic  of 
engaging  enemy  aircraft  only  at  altitudes  and  airspeeds  for 
which  maneuver  options  are  favorable  for  the  aircraft  under 
consideration . 

Variations  of  the  energy-maneuverability  models  have 
been  successfully  used  in  "man-in- the-loop, M real-time  ACM 

) 

simulations.  These  simulators  are  adaptations  of  the  differ- 
ential equations  governing  motions  of  powered  vehicles  in 
three-dimensional  space  in  response  to  actions  by  the  pilots. 
Consequently,  these  simulations  are  more  realistic  than 
representations  of  engagements  based  only  on  analytic  energy- 
maneuverability  models.  All  presently  operable  systems  are 


either  fixed  base  or  only  partially  moving  base,  and  limited 
to  three  aircraft  (two  versus  one) . 

The  energy-maneuverability  models  generally  cannot  be 
used  to  quantify  either  the  effect  of  less-than-optimal 
maneuvering  or  use  of  weapon  systems  to  compensate  for  the 
less-than-optimal  maneuvering.  These  deficiencies  are  some- 
what overcome  in  the  man-in-the-loop  simulators.  In  partic- 
ular, the  TACTICS  II  simulation  (Spicer  and  Martin,  reference 

7)  is  an  effort  to  incorporate  weapons  performance  into  the 
analysis. 

Game-Theory  Models 

Attempts  to  use  game-theory  techniques  for  analysis  of 
ACM  models  have  generally  been  unsuccessful.  Some  limited 
success  has  been  achieved  in  modeling  pursuit/evader  situa- 
tions with  differential  gaming  techniques  (Isaacs,  reference 

8)  . To  date,  such  models  have  been  deterministic  and  highly 
idealized.  However,  these  techniques  appear  to  offer  the 
potential  of  a detailed  understanding  of  ACM  models  by  offer- 
ing a technique  for  evaluating  some  of  the  non-deterministic 
parameters  in  decision  making.  An  excellent  review  of  both 
pursuit/evader  and  differential  games  applications  are  given 
by  Falco  in  reference  9.  This  is  a comparison  of  three 

such  models  which  compute  the  projected  outcomes  of  aerial 
engagements.  Some  elements  of  general  solutions  and  a 
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limited  approach  to  terminal  condition  analysis  by  game 
theory  models  is  given  by  Peng,  et  al  in  reference  10. 

Test  Range  Models 

The  general  analysis  trend  with  test  range  models  was 
to  analyze  individual  engagements  to  see  what  could  improve 
or  change  the  outcome.  The  pilot  it  was  felt,  was  an 
information  gatherer  and  interpreter,  and  if  he  was  provided 
with  all  the  information  (perfect  information) , then  with 
the  appropriate  training  (doctrine) , the  response  should  be 
known  and  provided  by  the  pilot  (perfect  pilot) . 

Such  a system  of  analysis  is  important  to  the  training 
aspects  of  engagement  dynamics.  Feedback  in  the  form  of 
what  information  to  look  for,  how  to  interpret  this  informa- 
tion, and  what  tactics  are  required  to  overcome  performance 
deficiencies  is  valuable  in  bringing  about  the  highest  level 
of  proficiency  in  execution.  It  is  precisely  this  reason 
that  led  to  the  development  of  the  test  ranges. 

These  types  of  analyses,  however,  are  meaningless  in 
relating  what  a trained  (proficient?)  squadron  of  men  and 
equipment  will  do  against  a viable  opponent.  The  main 
difficulty  lies  in  the  assumptions  embodied  in  the  previous 
analyses: 


i . 


• Perfect  information  does  not  exist.  Even  in 
an  information  rich  environment,  the  pilot  can- 
not assimilate  all  the  information  available  to 
him. 

• Perfect  pilot  does  not  exist.  No  matter  how 
well  trained  the  pilot  is,  he  cannot  respond 
exactly  as  desired  (some  may  do  better  than 
others)  even  if  the  needed  response  is  known. 

• Doctrine  is  incomplete.  All  possible  circum- 
stances provide  a continuum  of  events  and  at  best 
only  a finite  subset  can  be  considered. 

These  points  verify  those  raised  in  the  introductory 
section,  and  in  fact,  when  several  engagements  are  taken 
from  the  same  initial  conditions  and  executed  through  the 
same  tactics,  varying  results  are  obtained  (this  will  be 
demonstrated  later  in  this  paper). 

In  order  to  counter  these  problems  arising  from  the 
non-deterministic  outcomes  of  air  combat  maneuvering  (ACM) , 
three  distinct  analysis  techniques  have  been  developed.  The 
technique  used  is  dependent  upon  the  intended  use  of  the  ACM 
data.  The  first  technique  stems  from  the  desire  to  continu- 
ously monitor  airplane  performance  during  an  ACM  encounter, 
and  follow  the  progress  of  events  before,  during,  and  after 
a specific  occurrence  (such  as  slat  deployment) . This  type 


of  analysis  is  characterized  by  the  development  of  a per- 
formance index  which  is  purported  to  be  indicative  of  the 
airplane's  relative  ACM  performance.  The  advantage  of  such 
an  analysis  technique  is  the  ease  in  which  numerical  data  can 
be  used  to  form  conclusions  and  recommendations.  The  dis- 
advantages of  such  a system  of  analysis  are  the  inherent 
complexity,  the  difficulty  in  assigning  a proper  form  to  the 
performance  index,  and  the  required  detailed  knowledge  of  the 
computations  in  order  to  draw  conclusions.  An  example  of 
such  an  analysis  technique  is  the  airplane  directional  angle 
computation  developed  by  the  British,  McDonnell-Douglas , and 
NASA  Langley,  for  use  with  the  Harrier (AV-8A)  Vectoring  in 
Forward  Flight  (VIFF)  program. 

The  second  type  of  analysis  stems  from  a desire  for 
simplicity  in  computation  and  usability  of  the  data  by 
people  not  involved  in  the  actual  computations.  Such  an 
analysis  technique  is  represented  by  a discrete  computation 
based  upon  a given  set  of  conditions  (such  as  firing  oppor- 
tunities) . The  advantages  of  this  type  of  computation  are 
its  inherent  simplicity,  basically  self-explanatory  conclu- 
sions, and  ease  of  use.  The  disadvantages  are  that  it  does 
not  account  for  the  total  range  of  possibilities,  and  it  may 


or  may  not  be  difficult  to  distinguish  the  effect  of  isolated 
occurrences  in  the  data.  Such  an  analysis  technique  is  used 
in  most  tactical  manuals  for  pilots  and  is  typified  by  the  use 
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of  kill  probabilities  and  average  energy  states  or  box 
scoring  of  kills  (reference  11).. 

The  final  analysis  technique  combines  the  simplicity 
of  the  discrete  analysis  (and  some  of  its  disadvantages)  with 
the  increased  analysis  capability  of  the  continuous  analysis. 

The  technique  is  characterized  by  taking  the  continuum  of 
interairplane  relationships  and  breaking  it  into  discrete 
segments  or  ACM  states.  The  airplane  or  hardware  is  then 
evaluated  against  its  ability  to  maintain  or  change  the  ACM 
state  of  the  airplane  as  engagement  time  acculumates.  The 
ACM  state  analysis  technique  lies  between  the  continuum 
approach  and  the  discrete  approach  and  can  be  driven  to 
either  extreme.  By  defining  a very  large  number  of  states, 
the  analysis  becomes  nearly  continuum  and  carries  with  it 
the  advantages  and  disadvantages  previously  noted.  By  taking 
only  one  state  of  interest  (such  as  kills) , the  analysis 
becomes  discrete  and  carries  with  it  the  associated  advantages 
and  disadvantages  of  the  discrete  analysis. 

* 

The  ACM  state  analysis  technique  was  introduced  by 
Oberle  (reference  12)  and  has  been  used  on  flight  data, 
simulator  data,  and  computer  generated  data  (see  Nunn  and 
Oberle  (reference  5)).  The  technique  defines  ACM  states: 

. 

offensive  weapons,  offensive,  neutral  , defensive,  and 
defensive  fatal.  The  analysis  consists  of  measuring  the 
relative  ability  of  the  engaging  combatants  to  convert 
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between  states  by  assuming  that  the  trial  engagements  are  a 

i 

realization  of  either  a semi-Markov  or  second  order  semi- 
Markov^  process.  For  specific  analytic  details  and  examples, 
see  Oberle  (reference  12)  and  Nunn  and  Oberle  (reference  5) . 

Such  an  array  of  states  provides  simplicity  of  computation  and 
easily  used  data  (self-explanatory) . Because  the  analysis  is 
not  continuous,  it  does  not  allow  for  optimization  of  events. 

A reduction  of  the  number  of  states  from  five  to  three: 
firing  an  opponent,  maneuvering  with  opponent,  and  fired  upon 
an  opponent,  results  in  a finite  state  semi-Markov  model  known 
as  the  Firing  Sequence  Model.  The  model  has  been  used  for 
computing  the  probabilities  of  win,  loss,  and  draw  as  engage- 
ment time  accumulates.  For  further  analytic  details  and 
illustrative  examples,  see  Nunn  and  Oberle  (reference  5). 

The  analysis  technique  used  for  this  research  falls 
in  the  category  of  the  continuous  analysis  techniques.  A 
f igure-of-merit  or  performance  index  is  computed  at  each 
point  in  the  engagement.  The  time  variance  of  the  figure- 
of-merit  is  then  given  as  the  engagement  trend.  Figure  2 
gives  two  performance  indices  presently  in  use  for  reference. 

In  a Markov  process  the  transition  probability  between 
states  are  dependent  upon  current  states  and  independent 
of  prior  states.  These  transitions  occur  without  regard 
to  time.  The  semi-Markov  process  considered  is  a Markov  • 

process  where  time  in  state  is  a random  variable  whose 
density  function  depends  upon  the  state.  A second  order 
Semi-Markov  process  is  a semi-Markov  process  whose  transi- 
tion probabilities  are  conditioned  upon  the  prior  as  well 
as  current  state. 


FIG.  2:  EXAMPLES  OF  CONTINUOUS  ANALYSIS  PERFORMANCE  INDICES 


The  two  measures  of  figure  2 are  tailored  to  turning  per- 
formance, and  thus  include  only  jugular  terms.  Northrop* 
also  uses  a differential  energy  integral  defined  as: 
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This  is  designed  to  measure  the  time  advantage  of  a thrust 
minus  drag  or  thrust- to-weight  differential.  Other  indices 
exist,  but  are  also  tailored  to  a specific  aircraft  perfor- 
mance trait  and  are  not  indicative  of  the  relative  ACM 
position. 

The  second  type  of  analysis  (box  scoring)  is  the  most 
wide  spread  and  well  known.  This  is  primarily  because  prior 
to  1974,  air  combat  data  even  from  mock  engagement  trials  was 
very  difficult  to  get.  Radar  tracking  data,  together  with 
time  correlated  onboard  data  had  to  be  used  to  construct 
numerical  data. 

Analysis  of  ACM  testing  is  complicated  by  the  two  sets 
of  data  required  from  each  aircraft.  The  first  set  of  data 
consists  of  those  parameters  referring  to  the  specific  air- 
craft. These  aircraft  parameters  are  typified  by  airspeed, 
Mach  number,  load  factor,  angle  of  attack,  and  altitude. 

The  second  set  of  data  consists  of  those  parameters  referring 
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to  the  interrelationship  of  two  or  more  aircraft.  The  inter- 
aircraft parameters  are  typified  .by  range,  closing  velocity, 
and  relative  angles. 

The  two  indices  of  figure  2 reflect  the  primary  differ- 
ences in  data  gathering.  The  McDonnell-Douglas  Directional 
Angle  term  requires  both  onboard  and  radar  track  data  to  com- 
pute the  relative  positions  of  the  fuselage  reference  lines, 
while  the  Northrop  Angular  Advantage  term  requires  only 
radar  track  data.  The  difference  being  the  measures  of  angle 
of  attack,  sideslip,  etc.,  which  can  only  be  measured  by  on- 
board instrumentation. 

The  availability  of  air  combat  data  changed  radically 
with  the  operational  availability  of  the  Air  Combat  Man- 
euvering Range  (ACMR)  in  Yuma,  Arizona,  in  1974,  and  the  Air 
Combat  Maneuvering  Instrumentation  (ACMI)  range  at  Nellis, 
AFB,  Nevada,  in  1976. 

The  ACMR  was  developed  for  the  U.S.  Navy  by  the  Cubic 
Corporation  for  use  in  pilot  training  and  research,  develop- 
ment, and  operational  test  and  evaluation  of  ACM  problems. 

The  total  system  consists  of  an  area  of  controlled  airspace 
about  50  miles  east  of  Yuma,  Arizona,  with  tracking  stations 
and  radio  link  to  a computer  complex  for  display  and  com- 
munications. The  system  is  capable  of  handling  up  to  four 
aircraft  for  real-time  ACM  analysis.  A complete  description 
of  the  ACMR  is  contained  in  reference  13. 


The  ACMI  was  developed  for  the  U.S.  Air  Force  by  the 
Cubic  Corporation  for  use  in  pilQt  training  and  the  ACEVAL 
(as  well  as  other)  tests.  The  system  is  basically  an 
extension  of  the  ACMR  and  is  located  at  the  Nellis  Air  Force 
Base,  about  10  miles  north  of  Las  Vegas,  Nevada.  The  system 
is  capable  of  handling  up  to  eight  aircraft  for  real-time 
ACM  analysis.  A complete  description  of  the  ACMI  is  con- 
tained in  reference  14. 

The  two  systems  are  the  same  in  basic  concept  and  may 
be  characterized  as  inertially  aided  multi-lateration  systems 
designed  to  accurately  track,  monitor,  and  record  high  per- 
formance aircraft  data.  Using  simultaneous  range  measurements 
from  multiple  ground  stations,  a real  time  multi-lateration 
computation  uniquely  determines  the  position  of  the  aircraft 
with  respect  to  the  ground  reference  network.  Inertial  data 
communicated  from  the  aircraft  pod  via  an  integral  data  link 
permits  determination  of  aircraft  attitude.  These  data  are 
resolved  into  a situation  display  and  alpha-numerics  of  the 
engagement  particulars  and  are  made  available  for  display  at 
the  control  center.  Such  resolved  data  are  recorded  on 
magnetic  tape  for  later  playback  and  debriefing.  These  func- 
tions are  provided  by  the  following  sub-systems: 

• Display  and  Debrieifing  Subsystem  (DDS)  which 
includes  three-dimensional  situation  displays, 
alpha-numeric,  and  status  displays. 
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• Computation  and  Control  Subsystems  (CCS) , a 
large  multi-processor  for  real-time  computation. 

• Tracking  Instrumentation  Subsystem  (TIS) , a 
high-speed  phase-comparison  ranging  system. 

• Airborne  Instrumentation  Subsystem  (AIS) , a 
self-contained  pod  with  sensors  for  measuring 
and  transmitting  airplane  parameters. 

Display  and  Debriefing  Subsystem 
The  DDS  provides  real-time  three-dimensional  views  of 
the  flight  exercise.  This  subsystem  provides  the  data  entry 
capability  for  the  ACMR  and  ACMI  Missions,  ordnance,  type  of 
airplane,  scoring  criteria,  and  other  pertinent  data  required 
for  the  operation  are  automatically  entered  into  the  system. 
The  DDS  provides  a wide  variety  of  real-time  data  outputs. 
Three-dimensional  views  of  the  range  activity  to  include 
coordinate  transformation  as  well  as  reorientation  to  the 
pilot's  cockpit  view  are  available  upon  selection.  The  DDS 
provides  full  debriefing  capability  and  permits  viewing  scenes 
and  operations  that  were  not  viewed  during  the  real-time 
operations.  Summary  data  of  the  flight  operations,  including 
scoring,  are  provided  automatically  at  the  conclusion  of  a 
mission.  Further  details  are  contained  in  reference  13. 
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Command  and  Control  Subsystem 
Computation  of  airplane  position,  attitude,  inter- 
airplane parameters,  missile  trajectories,  flight  safety  . 
conditions,  and  identification  is  performed  by  the  CCS.  The 
location  of  each  airplane  is  correlated  with  both  missile  and 
airplane  characteristics  for  real-time  display,  recording  on 
magnetic  type,  hard  copy  print  out,  and  replay.  The  CCS  is 
a mobile  data  processing  center  utilizing  three  SIGMA-9  com- 
puters plus  normal  peripherals.  This  data  processing  system 
provides  real-time  outputs  pertaining  to  the  airplane  state 
vector,  interairplane  parameters,  and  missile  simulations. 

The  CCS  provides  the  total  state  vector  of  multiple  airplanes 

by  using  Kalman  filtering  techniques  and  incorporates  over 

2 

250,000  computer  instructions  for  real-time  data  reduction. 
Further  details  are  contained  in  reference  15. 

Tracking  Instrumentation  Subsystems 
The  TIS  consists  of  a master  station  and  six  unmanned 
remote  ground  stations  dispersed  throughout  the  range  area 
(operating  under  the  direction  of  the  CCS) . The  function  of 
the  TIS  is  to  simultaneously  track  and  identify  airborne 
targets  and  provide  two-way  data  and  voice  communications 
between  the  airplane  and  the  ground  stations.  Two-way  data 

2 : 

Real-time  in  this  instance  means  within  200  milliseconds 
which  under  some  conditions  may  be  termed  near-time. 


* 


29 


communication  is  also  provided  between  the  CCS  and  the  on- 
range  communications  network.  The  CCS  makes  possible  read- 
out and  correction  of  airplane  attitude  and  heading  refer-; 
ences  as  well  as  monitoring  of  airplane  weapons  status, 
firing  parameters,  and  other  mission-dependent  data.  Further 
details  are  contained  in  reference  16. 

Tracking  is  achieved  by  a high-speed  phase-comparison 
ranging  system  operating  on  computer-controlled  sequencing 
of  the  multiple  ground  stations.  By  this  technique,  contin- 
uous trilateration  slant  ranging  (accurate  to  4 feet)  defines 
the  position  of  each  airplane  to  within  25  feet.  Range 
measurements  are  taken  at  100  millisecond  intervals  for  high- 
performance  airplanes. 

Interrogation  of  a given  airplane  is  commanded  by  the 
CCS  through  the  master  control  statioh  to  any  of  the  down- 
range  units.  The  interrogation  is  uplinked  to  the  transponder 
in  the  airplane's  instrumentation  subsystem.  The  airplane's 
reply  is  via  all  units  in  the  ground  station  network,  thereby 
providing  multiple  paths.  This  system  redundancy  is  a fea- 
ture that  compensates  for  airplane  shadowing  and  blanking  of 
individual  TIS  sites. 

Airborne  Instrumentation  Subsystem 
.The  AIS  is  a self-contained  pod  with  external  dimensions 
and  aerodynamic  characteristics  similar  to  the  AIM-9  series 
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missile.  The  AIS  includes  an  attitude  reference  unit, 
ranging  transponder,  data  encoder,  weapons  bus  monitor,  "and 
air  data  sensor.  The  pod  is  attached  to  the  airplane  in  the 
same  manner  as  a Sidewinder  missile.  The  pod  is  wired  into 
the  airplane  through  existing  connectors  on  the  launch  rack. 
Further  details  are  contained  in  reference  17.  Figure  3 gives 
a summary  of  the  test  range  and  subsystems. 

The  primary  parameters  to  be  used  in  the  analysis  are 
given  in  table  1.  These  data  are  obtained  directly  from  the 
ranges.  The  basic  interairplane  parameters  defined  in  table  1 
are  shown  geometrically  in  figure  4,  together  with  a cone  of 
lethality. 

The  existence  of  test  ranges  is  necessary  for  the  type 
of  analyses  discussed,  to  provide  both  the  quantity  and 
quality  of  data  necessary  to  perform  the  mathematical  opera- 
tions. Although  configured  primarily  for  training  the  poten- 
tial of  these  test  ranges  for  R&D  exploitation  has  only  just 
begun.  This  exploitation  should  yield  significant  measures 
of  effectiveness  by  which  air  crew  capabilities  and  tactics 
can  be  evaluated.  A few  such  measures  are  delineated  in 
this  paper. 
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Closing  Velocity  (VC)  Time  rate  of  change  of  range 

Antenna  Train  Angle  (ATA)  The  angle  between  the  aircraft  reference  line  forward  of 

c.g.  and  any  sight  line 

Angle  Off  Tail  (AOT)  The  angle  between  the  aircraft  reference  line,  aft  6f  the 

c.g.  and  any  sight  line 
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EVALUATION  CRITERIA3 

The  evaluation  of  ACM  effectiveness  is  sufficiently 
complex  to  warrant  both  analytic  and  flight  test  investiga- 
tion. In  fact,  any  ACM  evaluation,  whether  it  be  of  the 
aggressive  ability  of  a fighter  weapon  system  or  the  surviva- 
bility of  an  attack  aircraft  in  a hostile  fighter  environ- 
ment, must  include: 

• A detailed  analytic  study  of  potential  ACM 
ability  and  the  formulation  of  preliminary  engage- 
ment tactics; 

• Preliminary  evaluation  of  the  postulated 
tactics  via  ACM,  man  in  the  loop,  simulation; 
and  finally 

• Flight  test  engagements  to  provide  the  final 
tactics  validation  and  effectiveness  estimates. 

While  this  sequence  has  been  followed  for  the  most  recent  ACM 
evaluations,  the  analysis  of  flight  test  data  has  not  routinely 
been  structurally  integrated  with  the  analysis  of  the  first 
two  test  phases.  Generally,  integration  has  consisted  of 
qualitative  assessment  of  the  consistency  of  the  relative 
trends  predicted  by  the  first  two  evaluation  stages  with  the 

^From  private  communications  with  Dr.  R.A.  Oberle,  reproduced 
here  with  his  permission. 
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results  of  the  flight  testing.  Additionally  a few  tactical 
measures  of  effectiveness  are  usually  presented  to  support 
(not  prove)  the  flight  test  assessment  of  ACM  effectiveness. 
When  results  appear  contradictory,  the  differences  are 
usually  treated  as  resulting  from  deficiencies  in  the  model 
driving  the  simulation,  deficiencies  in  the  conduct  of  test 
engagements  or  insufficient  data  sample.  Thus,  in  addition 
to  the  continued  development  of  an  analytic  technique  for  ACM 
evaluation,  effort  is  needed  to  integrate  the  analysis 
methodologies  employed  at  each  evaluation  stage.  The  models 
presented  here  make  it  possible  to  numerically  compare  the 
results  of  "man  in  the  loop"  simulation  engagements  with 
flight  test  engagements.  Thus,  the  methodologies  presented 
in  this  study  should  be  considered  as  complements  of  (rather 
than  replacements  for)  the  methodologies  already  available. 

The  development  of  a methodology  for  evaluating  test 
range  ACM  engagements  is  made  difficult  by  two  factors.  First, 
test  range  engagements  are  structurally  different  from  wartime 
engagements.  In  wartime,  ordnance  is  expended  and  vehicles 
are  destroyed.  On  the  other  hand,  during  a test  range  engage- 
ment, weapon  expenditures  are  only  simulated.  Generally,  each 
opponent  will  have  several  weapon  opportunities  each  of  which 
could  terminate  the  engagement  if  ordnance  were  actually  em- 
ployed. As  a result,  a test  range  engagement  cannot  easily 
be  classified  as  a win,  loss,  or  draw.  Moreover,  the  large 
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volume  of  manuevering  and  weapon  employment  data  available 
in  test  range  engagements  should  lead  to  a methodology  which 
can  be  expected  to  yield  a deeper  level  of  insight  into  the 
dynamics  of  an  engagement  than  a simple  win,  lose,  draw 
type  classification.  A second  difficulty  encountered  in 
modeling  ACM  is  the  multiplicity  of  structurally  different 
types  of  engagements.  Starting  with  the  basic  one  versus 
one  maneuvering  engagement,  the  complexity  increases  to 
engagements  with  many  combatants  fighting  simultaneously. 

In  addition  to  introducing  more  engaging  aircraft  into  the 
scenario,  it  should  be  noted  that  the  tactical  goals  of  the 
combatants  change  as  the  complexity  increases.  In  the  less 
complex  engagements,  survivability  and  intelligent  aggression 
are  combined  to  yield  very  vigorous  pursuit  type  combat.  In 
the  larger  more  complex  engagements,  survivability  becomes 
more  dominant  and  firing  incidents  occur  more  randomly  as 
shots  of  opportunity.  In  this  study,  only  methodologies 
appropriate  to  one  on  one  and  two  on  one  engagements  are 
developed.  The  evaluation  of  two  on  two  and  more  complex 
engagements  is  discussed  as  an  extension  of  the  methodologies 
developed. 
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CHAPTER  3 

AN  INDEX  OF  RELATIVE  WORTH 

* 

"...  the  orate  does  not  matter  ae  much  ae  who  eits  in  it." 

--  Manfred  von  Richthofen 
(WWI  German  Ace) 

COMPUTING  THE  INDEX 

The  approach  to  the  analysis  of  the  complex  problem  of 
interaction  is  somewhat  different  than  previous  attempts. 

Because  of  the  arithmetic  growth  in  aircraft  parameters  with 
aircraft  numbers,  and  the  geometric  growth  of  inter-aircraft 
parameters  with  aircraft  numbers,  a method  of  reducing  the 
number  of  parameters  to  be  analyzed  is  of  paramount  importance. 

This  not  only  makes  the  analysis  of  one  versus  one  easier  to 
follow,  but  it  makes  the  analysis  of  many  versus  many 
possible.  In  order  to  reduce  the  parameterized  information, 
a time-variant  figure-of-merit  is  computed. 

The  figure-of-merit  to  be  used  for  the  analysis  should 

4 y 

be  indicative  of  the  relative  advantage/disadvantage  of  a 
particular  set  of  circumstances  existing  in  time  and  should 

not  include  the  aircraft  capability  or  performance  which 

' 

should  be  reflected  in  a time-rate-of-change  of  the  perform- 
ance index.  The  derivation  of  a performance  index  will  be 
approached  from  an  examination  of  the  angular  geometry. 
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interairplane  distances,  and  interairplane  dynamics.  Fig- 
ure 5 shows  the  development  of  the  angular  geometry.  Fig- 
ure 5 shows  a definite  relation  between  the  sum  of  the 
antenna  train  angle  and  the  angle  off  tail.  This  sum  is  also 
directly  related  to  the  Directional  Angle  (DA)  term  of  figure 
2.  This  DA  makes  a reasonable  starting  point  for  a performance 
index  if  it  is  normalized  in  order  that  the  numerical  value 
will  have  intuitive  meaning. 

D&s  „ 100  [18°  - ] (2) 

Equation  2 yields  +100  for  the  best  angular  geometry,  -10 0 
for  the  worst  angular  geometry,  and  a value  of  0 for  the 
neutral  condition. 

The  total  geometry  and  interairplane  dynamics  must 
then  modify  the  normalized  directional  angle.  Figure  6 
shows  that  the  addition  of  the  range  term  alters  the  basic 
conclusions.  The  two  situations  are  identical  in  terms  of 
angular  geometry  alone,  but  the  ACM  situations  are  radically 
different  from  a standpoint  of  total  geometry.  For  example, 
in. figure  6 the  trailing  aircraft  is  seen  first  in  a tight 
trailing  position  which  may  represent  an  offensive  weapons 
delivery  point  (guns) , and  second  in  a long  trailing  posi- 
tion which  may  be  beyond  visual  sight  position  and  therefore 
have  no  offensive  value  whatsoever. 


AIRCRAFT  RELATIVE  POSITION  CHART 


INFLUENCE  OF  RANGE 


41 


To  account  for  this  reality,  a range  performance 
penalty  function  (fr)  is  introduced.  The  f is  shaped 
so  that  there  is  no  penalty  (fr  = 0)  when  the  ranges  are 
suitable  for  weapons  delivery  but  which  penalizes  the  per- 
formance index  when  the  range  is  beyond  the  weapon's  capa- 
bility and  neutralizes  the  fight  as  range  becomes  too  large 
for  offensive  maneuvering.  An  optional  penalty  may  be 
imposed  when  the  offensive  aircraft  is  at  a range  between 
a guns  and  a missile  envelope.  Such  a penalty  function, 
together  with  the  analytic  equation  it  represents,  is  given 
in  figure  7.  This  penalty  function  is,  of  course,  simply 
a curve  fit  of  what  alterations  should  be  made  to  the 
directional  angle.  A total  of  five  constants  are  available 
for  controlling  the  shape  of  the  curve: 

• — the  range  beyond  which  the  engagement 
conditions  are  considered  neutral. 

• Rqpt — the  range  which  is  optimum  for  the 
delivery  of  an  air-to-air  , missile. 

• Rq — the  range  at  which  gun  tactics  begin  to 
dominate  the  engagement  maneuvering. 

• fR(, — the  maximum  penalty  for  being  between  a 
guns  and  a missile  envelope  (usually  taken  to  be 
small) . 
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• Rq — the  range  below  which  no  penalty  will  be  t | 

imposed.  . ' j 

R represents  the  interaircraft  range. 

The  range  penalty  function  has  the  general  form  of  a 
sigmoid  curve  and  would  modify  the  DA  to  yield  a figure-of- 
merit  (FM)  as  follows: 

t 

f 

FM  = DAjj  (1  - fr)  (3) 

J 

The  f igure-of-merit  is  further  affected  by  interair-  I 

plane  dynamics.  The  effect  of  closing  velocity  is  illus-  i 

trated  in  figure  8.  That  the  two  situations  of  figure  8 are 
different  is  not  questionable,  but  how  they  are  different  is 
another  matter.  Just  what  an  advantage  or  disadvantage  is  in 
this  instance  is  a complicated  function  of  range  and  of fen-  , 

sive/defensive  position.  Certain  statements  can  be  made  for 

I I 

a positive  or  negative  energy  increment  as  tabulated  in 

i 

table  2. 

Table  2 was  generated  by  lengthly  discussions  with 
pilots  and  analysts  in  an  attempt  to  identify  where  and  under 
what  circumstances  energy  can  be  converted  to  position  in  an 
engagement.  These  complicated  relations  can  be  somewhat 
simplified  by  noting  that  for  everything  else  equal,  the 
effect  of  a positive  energy  increment  is  opposite  the  effect 
of  a negative  energy  increment,  and  the  effect  in  an  offensive 


^ : ■ . 


FIG.  8:  INFLUENCE  OF  CLOSING  VELOCITY 
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TABLE  2 


ENERGY  INFLUENCE  ON  PERFORMANCE  INDEX 


Range 

Energy  Increment 

ACM  State 

Conclusion 

Very  Close 

Positive 

Offensive 

Disadvantage  due  to 
move  toward  over- 
shoot 

Neutral 

No  effect 

Defensive 

Advantage  due  to 
move  toward  over- 
shoot 

Negative 

. 

Offensive  ■ 

Advantage  due  to 
increase  of  range 

Neutral 

No  effect 

Defensive 

Disadvantage  due  to 
increase  of  range 

Weapon 

Opportunity 

Positive  or 
Negative 

Offensive 

No  effect  unless 
weapon  parameters 
are  affected 

Neutral 

No  effect 

Defensive 

No  effect  unless 
weapon  parameters 
are  affected 

Larger  than 
weapon  opportunity 
but  less  than 
very  far 

Positive 

Offensive 

Advantage  due  to 
move  toward  weapon 
opportunity 

Neutral 

No  effect 

Defensive 

Disadvantage  due  to 
move  toward  weapon 
opportunity 

Negative 

Offensive 

Disadvantage  due  to 
move  away  from 
weapon  opportunity 

Neutral 

No  effect 

Defensive 

Advantage  due  to 
move  away  from 
weapon  opportunity 

Very  far 

Positive  or 
Negative 

All 

No  effect 

state  is  the  opposite  of  the  effect  in  a defensive  state.  A 
function  (K)  reflecting  these  influences,  as  given  in 
figure  9,  modifies  the  f igure-of-merit  and  yields  perfor-, 
mance  index  as  follows: 

PI  « DAjj  (1  - f r ) K (4) 


As  in  the  range  penalty  case,  the  energy  function  is  simply 
a curve  fit  of  what  is  represented  in  table  2.  The  range 
values  ROPT'  R0'  R^  are  as  they  were  defined  under 

the  range  function.  Eg  is  the  weight  specific  energy  of  the 
aircraft  defined  in  equation  (5) . 


E 


S 


= h 


(5) 


where  h is  the  aircraft  altitude,  v is  the  aircraft 
velocity,  and  g is  the  acceleration  of  gravity.  AEg  is 
the  energy  difference  between  fighter  and  adversary  and  Eg 
is  the  average  energy.  The  quantity  AEg/Eg  then  represents 
the  relative  percentage  discrepancy  in  energy.  Finally,  the 
coefficient  Edev  is  available  for  tempering  the  amount  of 
influence  the  energy  coefficient  has  on  the  performance 


index 


FIG.  9:  ENERGY  INFLUENCE  FUNCTION 
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The  maneuver  conversion  model  is  an  ACM  state  type 
analysis  and  is  the  most  fully  developed  of  the  non- 
deterministic  analysis  methods  (Oberle,  reference  12) . The 
maneuver  conversion  model  characterizes  ACM  engagements  as 
a realization  of  a semi-Markov  process  with  state  conversion 
probabilities  and  time  in  state  distributions.  It  was  also, 
the  first  non-deterministic  model  to  be  applied  to  actual 
flight  data.  See  Chapter  2 for  further  discussion. 

Figure  10  is  a comparison  between  the  computed  per- 
formance index  (equation  4)  and  the  maneuver  conversion 
model  (reference  12) , for  an  actual  test  engagement  done 
at  the  ACMR,  Yuma.  The  figure  shows  close  agreement  in 
engagement  trend,  but  the  performance  index  allows  the 
analyst  to  determine  the  transition  points  much  more  accur- 
ately. For  example,  in  figure  10,  the  point  at  which  the 
fighter  begins  to  show  a negative  engagement  trend  is 
around  59  seconds,  and  if  the  defensive  state  is  established 
at  PI  = -30,  the  fighter  became  defensive  at  72  seconds 
into  the  engagement.  The  maneuver  conversion  model  only 
indicates  the  point  at  which  the  fighter  became  defensive; 
figure  10  also  illustrates  the  sensitivity  of  the  discreet 
model  to  the  accuracy  of  parameters.  A small  angular  change 


COMPARISON  OF  THE  PERFORMANCE  INDEX 
WITH  THE  MANEUVER  CONVERSION  MODEL 


(as  little  as  1 degree)  can  cause  the  state  change  that 
occurs  at  81  seconds.  No  such  influence  is  present  in  the 
performance  index  which  has  a small  sensitivity  to  small  , 
changes  in  parameters  and  a large  sensitivity  to  large 
changes  in  parameters. 

Directional  Angle 

The  directional  angle  was  developed  as  an  engagement 
by  engagement  measure-of-ef fectiveness  in  time  by  MfcDonnell- 
Douglas  for  use  with  the  analysis  of  Harrier  (AV-8A)  air 
combat  trials.  It  is  primarily  a measure  of  turning  per- 
formance advantage/disadvantage  and  was  developed  to  demon- 
strate the  effectiveness  of  thrust  vector  control  in 
maneuvering. 

Figure  11  shows  with  the  same  engagement  the  comparison 
between  the  computed  performance  index  and  the  computed 
directional  angle  with  the  exception  that  the  data  were 
normalized  (to  the  range  of  +100  to  -100)  for  purposes  of 
comparison.  The  two  analysis  techniques  give  a marked  dif- 
ference in  engagement  trend  during  the  first  60  seconds  of 
the  encounter.  During  this  portion  of  the  engagement,  the 
fighter  is  trading  angles  for  range  (up  to  36  seconds) , and 
the  directional  angle  analysis  method  does  not  consider  this. 
The  actual  separation  became  24,000-30,000  feet  (7  300-9  100  m) 
which  is  enough  range  to  suppress  the  performance  index  to 
neutral  with  the  constants  used.  The  small  differences  that 
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FIG.  11:  COMPARISON  OF  THE  PERFORMANCE  INDEX  WITH  THE 
DIRECTIONAL  ANGLE  CRITERIA 
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occur  after  60  seconds  are  primarily  due  to  the  energy  in- 
fluence which  favors  the  fighter  .and  reduces  his  defensive 
posture  slightly. 

PERFORMANCE  INDEX  PARAMETER  STUDY 
Range  Effects 

Figure  12  shows  the  effect  of  the  maximum  range  para- 
meter by  computing  the  performance  index  (all  else  being 
equal)  for  two  different  values  of  As  expected,  the 

smaller  value  of  suppresses  the  engagement  to  neutral 

with  the  most  profound  effect  coming  between  120  and  140 
seconds  (this  is  caused  by  ranges  between  12,000  and  16,000 
feet  (3600  and  4900  m) ) . In  each  of  the  parameters  examined, 
the  same  engagement  is  used  for  comparative  purposes. 

In  general,  the  R^^  parameter  represents  the  maximum 
interairplane  range  beyond  which  the  engagement  is  considered 
neutral.  This  is  generally  a sight  type  of  parameter  but 
could  be  interpreted  to  be  seeker  head  or  radar  ranges  for 
individual  weapons  analyses.  The  R^^  values  in  table  3 
are  based  upon  using  sight  as  the  engagement  criteria.  These 
data  are  estimated  from  discussions  with  pilots  at  the  Naval 
Fighter  Weapons  School,  VF-111,  VX-4,  and  others.  In  any 
given  application,  these  values  may  change  or  may  even  become 
a function  of  engagement  parameters  such  as  altitude,  meteo- 
rology, and  background  (sky,  terrain,  sun,  etc) . 
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TABLE  3 


ESTIMATED  VALUE  OF 


RMAX 


FOR-  SPECIFIC  AIRCRAFT  TYPES 


Aircraft 


MIG- 17  FRESCO 

24,000 

ft 

(5 

490 

m) 

MIG- 19  FARMER 

26,000 

ft 

(7 

920 

m) 

MIG-21  FISHBED 

27,000 

ft 

(8 

230 

m) 

MIG- 2 3 FLOGGER 

27,000 

ft 

(8 

230 

m) 

MIG- 2 5 FOXBAT 

30,000 

ft 

(9 

140 

m) 

F-4  PHANTOM 

30,000 

ft 

(9 

140 

m) 

F-8  CRUSADER 

24,000 

ft 

(7 

320 

m) 

F-14  TOMCAT 

27,000 

ft 

(8 

230 

m) 

A- 4 SKYHAWK 

24,000 

ft 

(7 

320 

m) 

F-5  TIGER 

18,000 

ft 

(5 

490 

m) 

F-106  DART 

30,000 

ft 

(9 

140 

m) 

F-15  EAGLE 

27,000 

ft 

(8 

230 

m) 

F-18  HORNET 

26,000 

ft 

(7 

920 

m) 

NOTE: 


(1)  Select  Rmax  corresponding  to  defensive  aircraft. 
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Appendix  B gives  data  pertinent  to  ACM  analyses  for  the  air- 
craft as  taken  from  references  1-9-21. 

Figure  13  shows  the  influence  of  two  different  values 
of  optimum  range.  The  expected  result  of  minimum  influence 
for  moderate  change  is  desirable  because  the  curve  should 
generally  be  flat  in  the  area  of  an  optimum  missile  launch. 

This  also  allows  some  latitude  in  the  choice  of  the  optimum 
range  parameter.  The  optimum  range  parameters  chosen  for 
this  comparison  are  not  representative  of  a typical  weapon, 
but  do  fall  within  the  values  generally  associated  with  the 
AIM-9  or  ATOLL  heat  seeking  series  of  missiles,  currently 
employed  in  large  numbers  in  many  countries  (including 
communist  block  countries) . 

Energy  Effects 

Figure  14  shows  the  computed  value  for  two  different 
values  of  energy  coefficient  (E<jev^  • T^e  effects  of  this 
parameter  are  subtle  with  the  fighter  enjoying  about  a 33% 
advantage  in  specific  energy.  A long-term  energy  advantage 
will  be  reflected  in  the  index  as  a range  or  angle  influence. 

The  effect  will  be  much  more  pronounced  in  a slashing  type 
of  engagement  (high  energy)  where  the  fighter  may  enjoy  as 
much  as  100%  energy  advantage.  The  coefficient  Edev  may 
be  chosen  to  yield  the  energy  effect  desired.  Test  cases 
used  0.5  for  computation.  In  general,  Edev  will  be  between 
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FIG.  13:  INFLUENCE  OF  OPTIMUM  RANGE  PARAMETER 
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One-On-One  Engagement 
Fighter  Versus  Adversary 

Rqpt  - 6,000  ft  (1830  m)  Edev  - 0.5 

R0  - 500  ft  (150  m)  Edev  - 1.0 


FIG.  14 


INFLUENCE  OF  ENERGY  COEFFICIENT 
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0 and  2.0  and  is  chosen  to  yield  the  desired  magnitude  of 
energy  influence. 

Interenvelope  Gun  Penalty 

The  interenvelope  gun  penalty  was  structured  into  the 
model  to  include  the  case  of  an  aircraft  carrying  long-range 
missiles  and  guns  with  no  intermediate  range  missile.  In 
cases  where  the  gun  and  missile  envelope  overlap,  the  penalty 
would  be  zero.  Test  cases  have  used  an  arbitrary  .025 
value  for  fRQ.  Since  no  data  sets  were  used  where  this 
parameter  had  a profound  effect,  sensitivity  was  not  explored. 

EXTENSION  TO  MULTIAIRCRAFT 

One  of  the  most  difficult  areas  of  ACM  analysis  is  the 
extension  to  the  multiaircraft  situations.  Each  additional 
aircraft  adds  a multiplicity  of  complications  to  the  problem 
both  conceptually  and  mathematically.  Few  models  attempt 
extension  to  this  area  even  though  an  actual  engagement  has 
a much  higher  probability  of  being  multiaircraft  them  one-on- 
one.  Table  4 is  an  extract  of  reference  12  and  gives  the 
logic  in  constructing  a two-on-one  maneuver  conversion  model. 
The  table  was  constructed  through  extensive  analysis  of  two- 
on-one  engagements  and  pilot  interviews  and  is  both  logical 
and  intuitive.  It  does  not,  however,  follow  precise  mathe- 
matical trends.  For  example,  the  simultaneous  existence  of 
an  offensive  fighter  and  defensive  fighter  does  not  give  a 
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TABLE  4 

RULES  FOR  STATE  EVALUATION  OF  A TWO-ON-ONE  ENGAGEMENT 

1.  The  section*  is  OFFENSIVE  WEAPON  when  at  least  one  member 
is  in  offensive  weapon  state  and  the  other  is  higher  than 
a fatal  defensive  state. 

2.  The  section  is  OFFENSIVE  when  at  least  one  member  has  an 
offensive  position  and  the  other  is  higher  than  a fatal 

x defensive  state. 

3.  The  section  is  NEUTRAL  when  both  members  are  in  neutral 
state. 

4.  The  section  is  DEFENSIVE  when  at  least  one  member  is  in 
defensive  state  and  the  other  is  either  neutral  or 
defensive. 

5.  The  section  is  FATAL  DEFENSIVE  when  at  least  one  member 
is  in  fatal  defensive  state  and  the  other  has  less  than 
offensive  weapon  state. 

6.  The  section  is  in  a TRADEOFF  state  when  one  member  of 
the  section  is  in  offensive  weapon  state  and  the  other 
is  in  a fatal  defensive  state. 


*A  section  is  defined  as  the  total  number  of  friendly  or 
adversary  aircraft  involved  in  the  engagement. 
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neutral  section  (condition  2 of  table  4) . The  extension  of 
the  performance  index  will  be  in.  the  same  manner  as  the 
maneuver  conversion  model:  i.e.,  a section  performance  ijidex. 

Figure  15  shows  a two-on-one  engagement,  together  with 
its  maneuver  conversion  model,  for  both  fighter- to- target 
pairs.  This  particular  engagement  is  of  specific  interest 
because  of  the  tradeoff  situation  between  50  and  60  seconds 
and  the  reversals  of  the  ACM  state  present  for  the  section. 

The  individual  indices  follow  well  the  engagement  trends  of 
the  maneuver  conversion  model,  but  the  combination  must  also 
follow  for  a section  coefficient. 

After  many  trials,  a mathematical  form  of  section  co- 
efficient was  derived  which  could  follow  the  maneuver  conver- 
sion extension  as  shown  in  figure  16.  The  specific 
calculational  procedure  termed  magnitude  sum  is  given  by: 


The  absolute  value  accounts  for  the  sign  of  the  individual 
engagement  indices.  Tradeoff  was  established  by  looking  at 
the  individual  aircraft  performance  indices  and  appears  to 
lag  in  time  but  this  is  not  deemed  significant  because  of  the 
sensitivity  of  the  maneuver  conversion  model  to  small 
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FIG.  15:  INDIVIDUAL  FIGHTER  AIRPLANE  PERFORMANCE  IN  A 
TWO-ON-ONE  ENGAGEMENT 
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FIG.  16s  FIGHTER  SECTION  PERFORMANCE  INDEX  FROM  MAGNITUDE 
SUM  METHOD 


MANEUVER  CONVERSION  MODEL 
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parameter  changes  as  discussed  previously.  The  section  per- 
formance index  is  directly  extendable  to  larger  engagements 
(more  aircraft)  by: 


E <PV  I PIi  I 

i=l  _ 

E (pii>  I pii I 

i=l  1 1 


±C 


(8) 


PI, 


n 


i=l 


(PIi) 


PI. 


(9) 


where  C is  a proportionally  constant  to  establish  maximum 
and  minimum  values.  For  PIg  = ±100,  C is  equal  to  the 
square  root  of  the  inverse  of  the  number  of  pair  possibilities. 

The  performance  index  is  reflective  of  the  trend  of 
individual  engagements  as  verified  by  comparison  with  other 
analytic  techniques  and  critiques  of  air  crews  involved  in  air 
combat  trials.  As  stated  earlier,  however,  each  engagement 
is  unique  and  does  not,  in  itself  represent  the  capabilities 

1 * 

of  either  aircraft  or  aircrews.  The  remainder  of  this  report 
will  deal  with  the  analysis  of  several  trials  as  a group,  as 
well  as  individual  engagement  trials. 


CHAPTER  4 


THE  CHARACTERIZATION  OF  MULTIPLE 
EXPERIMENTAL  TRIALS 

" In  speaking  about  the  past  war,  the  first  thing  we 
encountered  in  engagement  with  the  enemy  were  tens  and 
hundreds  of  unexpected  things. " 

--  Lt.  Gen.  of  Aviation  G.  Pavlov,  USSR 


MULTIPLE  TRIALS 

Because  in  the  case  of  dynamically  interactive  systems, 
the  response  to  a given  situation  is  governed  by  anticipation, 
interpretation,  expectation,  and  other  intangibles,  each 
trial  is  unique.  In  fact,  when  several  trials  are  conducted 
from  precisely  the  same  initial  conditions,  a wide  variety  of 
outcomes  results.  Such  a variety  of  outcomes  at  first  per- 
plexed analysts  who  turned  to  statistical  descriptors  such  as 
box  scoring  described  in  Chapter  2.  In  fact,  the  training  of 
fighter  pilots  included  a large  discussion  on  what  to  do  in 
given  situations.  The  execution,  however,  often  went  some- 
thing like  — "After  two  turns  I could  see  that  he  would  .... 

So  instead  of  ....  I ....  -ed."  While  initially  frustrating 
to  the  analyst  it  can  be  seen  that  the  interaction  described  is 
highly  desireable,  and  the  adaptive  feedback  loops  working  to 
counter  the  opponent  are  the  very  ones  that  make  each  trial  a 
unique  event.  The  uniqueness  of  events  is  best  demonstrated 
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in  figure  17.  Figure  17  represents  thirty-three  (33)  engage- 
ments  of  two  fighters  versus  one  adversary  as  taken  from  data 
flown  on  the  ACMR  at  Yuma,  Arizona.  The  tape  of  similar 
engagements  was  created  by  the  control  structure  shown  in 
figure  18,  and  with  the  program  logic  shown  in  figure  19. 

This  data  extraction  procedure  is  part  of  a large  scale  data 
extraction  and  analysis  procedure  known  as  the  "ACMR  Readi- 
ness Estimation  System"  that  is  now  operational  at  the  ACMR 
in  Yuma,  Az.  Details  of  the  ACMR  Readiness  Estimation  System 
are  described  in  Oberle,  Naron,  and  Simpson  (reference  22) . 

Figure  18  shows  the  breakdown  of  the  computational 
methods  by  seven  inter -active  program  modules  as  follows: 

• DEBRIEF — reads  data  not  automatically  recorded 
by  the  system  such  as  pilot  comments,  first  visual 
sighting  by  an  aircrew  (tally) , calls  for  break- 

f ' 

off  of  the  engagement  (BUGOUT)  and  low  fuel 
states  (BINGO) , etc. 

• GETOBS — Gets  the  observed  or  recorded  data. 

• ACMRDB — the  driver  program  which  controls  the 
flow  of  data  and  interfaces  directly  with  DEBRIEF, 

GETOBS,  and  CRTREC  as  shown  in  figure  19. 

• CRTREC — computes  real  time  records  by  control 
of  three  calculations!  routines;  IAP,  ENVIND,  SAP. 


FIG.  17:  PERFORMANCE  INDEX  TIME  DATA  FOR  33  ENGAGEMENTS 


FIG.  19:  PROGRAM  LOGIC  FOR  ACCUMULATION  OF  ENGAGEMENTS 
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• IAP — computes  inter-aircraft  parameters  for  all 
pair  possibilities. 

• SAP — computes  single-aircraft  parameters  for 
each  aircraft. 

• ENVIND — computes  individual  weapons  envelopes 
to  see  if  a firing  solution  has  been  satisfied. 

The  results  are  then  output  to  tape  for  further 
analyses.  The  individual  engagement  tapes  are  then  released 
back  to  the  system  for  reuse  on  further  engagements. 

The  engagements  of  figure  17  are  fairly  typical  of  the 
four  data  sets  examined.  Although  each  engagement  starts 
from  an  initially  neutral  position  (head  on  pass,  near  zero 
performance  index) , it  can  be  seen  that  there  is  little 
similarity  in  outcomes.  The  initial  conditions  was  taken  as 
the  first  visual  sighting  of  an  opponent  (tally) . The  section 
performance  index  was  computed  as  described  in  Chapter  3 on  an 
engagement  by  engagement  basis  and  placed  in  the  cumulative 
tape  file. 

The  uniqueness  of  individual  engagements  is  not  unknown, 
and  many  analysts  feel,  not  without  justification,  that  air 
combat  data  must  be  handled  on  an  engagement  by  engagement 
basis.  See,  for  example.  Youngling,  et.  al.  (reference  23). 
While  the  analysis  of  individual  engagements  is  necessary. 
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techniques  for  the  analysis  of  the  multiple  engagement  set 
as  an  entity  are  presented. 

QUANTIFYING  THE  RANGE  OF  EVENTS 

Since  the  uniqueness  of  each  engagement  is  part  of  a 
continuum  of  events  when  described  by  an  index  of  continuous 
nature,  it  becomes  natural  to  look  for  upper  and  lower  bounds, 
and  a characteristic,  expected,  or  most  likely  value.  The 
upper  and  lower  bounds  are  computationally  set  in  the  struc- 
ture of  the  performance  index  as  ±100  since  the  index  was 
normalized  to  these  values  as  discussed  in  Chapter  3.  The 
computation  of  expected  values  suggests  a statistical 
descriptor  such  as  a density  function,  and  the  physical 
problem  suggests  a time  sequence  of  events  such  that  the 
basic  approach  to  quantifying  multiple  trials  is  shown  in 
figure  20.  Thus,  the  family  of  engagements  is  taken  as  a 
realization  of  a stochastic  process  characterizing  the  rela- 
tive air  combat  ability  of  the  opposing  forces.  The 
analysis  techniques  to  be  described  are  motivated  by  this 
observation.  The  first  application  of  this  observation  to 
the  performance  index  for  a family  of  air  combat  trials  is 
included  in  Simpson  and  Oberle  (reference  24) . 

As  shown  in  figure  20,  data  is  taken  at  each  discrete 
time  slice  tA  and  a density  (frequency  of  occurrence) 
function  is  computed.  This  set  of  computed  density  values 
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will  be  referred  to  as  the  one-dimensional  distributions 
(one-dimensional  because  there  is  no  cross-correlation  in 
time  or  value).  In  general,  although  not  necessary,  the  ex- 
perimental trials  should  begin  from  a given  initial  condition, 
and  each  engagement  should  have  the  same  approach  to  tactics, 
and  set  of  ground  rules  for  the  analysis  to  have  meaning. 

THE  COMPUTATION  OF  DISTRIBUTIONS 
General 

The  general  problem  of  estimating  an  underlying  distri- 
bution from  a given  number  of  random  samples  has  been  heavily 
treated  only  for  the  case  of  known  distribution  form.  These 
are  generally  referred  to  as  point  estimators  and  are  dis- 
cussed in  detail  by  Mood,  et  al,  in  reference  25.  Many 
attempts  have  been  made  to  the  problem  of  estimating  an  un- 
known underlying  distribution,  or  to  verifying  the  form  of 
an  underlying  distribution  (such  as  hypothesis  testing,  see 
Van  Trees,  reference  26),  but  for  the  most  part  have  required 
a large  sample  size  for  the  accurate  determination  of  either 
distribution  forms  or  values.  A computational  procedure  for 
evaluating  the  empirical  distribution  function  has  been 
worked  out  by  Curry  and  Egbert  (reference  27) . This  work  is 
an  application  of  the  work  of  Parzen  (reference  28)  and  Murthy 
(reference  29).  Figure  21  shows  the  basic  algorithm  used  in 
computing  frequency  distributions  as  taken  from  reference  27. 


FIG.  21:  DISTRIBUTION  RECOVERY  TECHNIQUE 
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In  figure  21,  M random  data  samples  (X^....XM)  are  used 
to  compute  the  estimated  frequency  of  occurrence  (fM)  at  the 
point  X (which  may  or  may  not  be  a value  in  the  random 
data  set) . y and  p are  computed  intermediate  steps  and 
6 is  an  empirically  derived  constant.  H is  a weighting 
function  which  determines  neighborhood  of  influence  of 
observed  samples  about  the  point  X.  The  value  of  6 was 
taken  as  the  empirically  derived  value  presented  by  Curry  and 
Egbert,  and  the  function  H was  chosen  to  satisfy  the 
following  requirements: 

• H (x)  is  non-negative 

• H (x)  is  even 

• lim  H(x)  =0 

I I x | | -►+- 

In  the  general  case  H(x)  would  have  to  be  normalized  over 
the  infinite  interval,  but  this  requirement  was  dropped  since, 
in  this  case  at  least,  it  was  to  be  normalized  subsequently 
over  a finite  interval  of  ±100  for  the  performance  index. 

The  primary  assumption  in  the  development  of  the  distributional 
estimation  is  that  the  unknown  underlying  distribution  have  a 
finite  variance.  While  it  is  unknown  at  this  point  whether 
the  underlying  distribution  has  satisfied  this  requirement, 
each  of  the  estimated  distributions  has  thus  far  met  the 
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requirement  (at  least  to  numerical  order  of  magnitude) . This 
requirenent  is  based  upon  defining  the  estimated  distribu- 
tion as  in  unbiased  estimator.  The  fact  that  the  estimated 
distribution  be  unbiased  is  critical  to  the  analysis. 

Small  Sample  Size 

One  of  the  most  attractive  features  of  the  Curry  and 
Egbert  methodology  is  the  manner  in  which  it  handles  small 
sample  sizes.  A change  in  the  computation  of  the  exponential 
multiplier  (p)  occurs  when  the  relative  sample  size  (u)  be- 
comes small.  As  shown  in  figure  21  this  relative  sample  size 
is  a measure  of  the  ratio  of  sample  spread  to  the  number  of 
samples : 


y(M)  M(M  - 1)  ^ ^ (Xi  ~ Xj}  (10) 

1.U  1|U 

where  X^  and  Xj  are  the  l and  j observed  samples,  re- 
spectively. This  change  in  computation  allows  for  a slower 
fall-off  in  accuracy  when  dealing  with  small  sample  sizes. 
Table  5 as  taken  from  reference  27  shows  the  accuracy  of 
estimation  for  a normally  distributed  data  set  using  the  mean 
square  error  (e)  taken  over  a 101  point  interval  from  the 
following  definition: 
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TABLE  5 

SENSITIVITY  OF  FREQUENCY  FIT  TO  SAMPLE  SIZE 
(reference  29) 


Sample  Size 


Mean  Square  Error 


M e 


15 

3.764 

X 

10-3 

25 

3.903 

X 

10~3 

50 

4.648 

X 

io-4 

75 

1.599 

X 

io‘3 

100 

8.843 

X 

O 

1 

250 

7.959 

X 

H* 

O 

1 

500 

3.485 

X 

10-4 

999 

5.340 

X 

10-5 

f 


t 
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100 

L 

K=0 


<fM(*k>  - 


f(yk)> 


(ID 


where 

is  the  computational  point 
f is  the  known  underlying  frequency 
fw  is  the  estimated  underlying  frequency 
and  e is  the  mean  square  error. 

While  table  5 demonstrates  an  increase  in  accuracy  with 
sample  size,  the  sample  size  of  15  yielded  a mean  square 
error  which  is  0.4%  of  the  area  under  the  frequency  curve. 
Curry  and  Egbert  demonstrate  frequency  fits  for  several 
other  distributions  with  the  same  general  trend.  The  worst 
fit  appears  to  come  from  the  uniform  distribution,  which 
may  have  an  error  as  high  as  15%  at  15  samples. 

Implementation 

The  implementation  (FREDIS) , of  the  Curry  and  Egbert 
methodology  was  taken  as  shown  in  figure  21,  with  the  excep- 
tions noted.  Additionally,  the  following  computational 
algorithms  were  added  to  the  determination  of  frequency: 

• An  integration  routine  (QSF)  for  integration 
of  equally  spaced  functions  using  a combination 
of  Simpson's  rule  and  Newton's  three-eighths  rule. 
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The  routine  was  used  for  normalization  of  the 
frequency  function  and  for  computing  probabilities 
of  occurrence  defined  as: 

P<a,b>  * / <12> 


where  P<a  ^ is  the  probability  of  occurrence 
of  the  variable  in  the  interval  a,b.  If  a is 
the  lower  bound  (L.B.)  and  b is  a variable, 
then: 

P(b)  = fh  f (x)  dx  (13) 

‘'L.B. 

and  P(b)  is  the  cumulative  probability  of 
occurrence.  This  implementation  was  taken  from 
reference  30  with  only  slight  modifications. 

T 

o A moment  generating  routine  (MOMEN)  calculating 
the  classical  moments  of  distributed  functions 
with  a given  frequency  distribution.  This 
algorithm  is  available  in  most  statistics  books 
but  was  specifically  taken  from  Kendall  (refer- 
ence 31)  . 
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This  implementation  was  then  tested  against  three  known 

f 

distributional  sets  to  assure  its  integrity.  Multiple  data 
runs  against  each  of  the  normal,  exponential,  and  uniform, 
distributions  yielded  resonable  data  fits  to  as  low  as  10 
data  samples,  which  was  used  as  a lower  bound  for  computations. 

The  specific  implementation  is  given  in  appendix  C because  of 
its  uniqueness  and  possible  widespread  application. 

TEST  DATA  CHARACTERIZATION 

The  data  presented  in  figure  17  were  characterized  as 
shown  in  figure  20  by  the  algorithms  of  figure  21,  modified 
as  discussed,  and  by  the  control  structure  shown  in  figure  22. 

Figure  22  shows  the  test  data  characterization  broken  down 
into  six  computation  modules: 

• ACE1 — control  of  input,  output,  vector 
stripping  of  matrix  data,  and  some  calculational 
procedures. 

• RDEVAL — reads  and  decodes  the  cumulative  tape  1 

file. 

• FREDIS — computes  the  frequency  fit  as  pre- 
viously discussed. 

• QSF — integration  routine  from  reference  30. 


80 


FIG.  22:  ANALYSIS  LOGIC 


• MOMEN — moment  generating  routine. 


• START — a routine  which  allows  the  engagement 
to  start  at  first  tally,  a specified  inter- 
aircraft range,  or  a specified  time. 

Figure  23  shows  the  frequency  data  as  taken  at  10 
second  intervals  over  the  first  50  seconds  of  the  engagement 
set.  These  data  are  normalized  so  that  the  area  under  each  of 
the  curves  is  identical  and  equal  to  1.0.  Figure  24  gives 
the  cumulative  probability  (integrated  frequency  data)  for 
the  same  engagement  set.  These  data,  together  with  their 
statistical  descriptors  (mean,  variance,  higher  order 
moments)  will  be  taken  as  the  characterization  of  the  data 
set.  Use  of  these  data  in  the  detailed  analysis  of  air 
combat  will  be  given  in  the  next  chapter. 


CHAPTER  5 


THE  ANALYSIS  OF  ENGAGEMENT  TRIALS 

"I  believe  in  perfect  laws  in  a world  of  existing  thingst,in 
so  far  as  they  are  real , which  I try  to  understand  with  wild 
speculation . " — /i.  Einstein 

INDIVIDUAL  ENGAGEMENTS 

A large  amount  of  the  analysis  that  can  be  performed 
with  dynamically  interactive  systems  is  in  the  examination 
of  individual  experiments.  In  the  application  under  consid- 
eration, it  is  especially  true  in  the  training  and/or  testing 
cycles  where  the  individual  engagements  may  have  their 
largest  impact  on  the  system. 

In  the  training  cycle,  it  is  important  to  recognize 
flaws  in  the  execution  of  tactics  so  that  they  can  be  cor- 
rected or  practised  until  flawless  execution  can  be  achieved. 
Alternatively,  effective  counter-measures  can  be  recognized 
or  developed,  or  counters  to  counter-measures  can  be 
developed.  Figure  10  of  Chapter  3 shows  4 significant  break 
points  where  detailed  analysis  should  be  undertaken.  At 
each  of  59,  79,  106  and  131  seconds  significant  events  take 
place  which  alter  the  engagement  trend.  The  first  three 
are  directly  attributable  to  actions  by  either  the  fighter  or 
the  advesary,  the  fourth  break  point  does  not  correlate  with 
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a specific  event  but  is  probably  associated  with  the  termina- 
tion of  the  engagement. 

In  the  testing  cycle,  the  performance  index  can  be  used 
to  evaluate  the  usefulness  of  a device  or  system  in  a particu- 
lar situation.  Figure  25  shows  the  computation  of  the  per- 
formance index  for  two  similar  aircraft,  one  of  which  was 
modified  to  include  a device  which  had  potential  application 
to  the  air  combat  environment.  The  modified  aircraft  has 
been  placed  at  a decided  disadvantage  (in  the  weapons  envelope 
of  the  opponent)  and  the  test  is  to  ascertain  whether  or  not 
the  device  can  assist  the  pilot  in  the  modified  aircraft. 

As  shown  in  figure  25,  a direct  correlation  between  device 
useage  and  short  term  (tactical)  gains  is  evident.  In  the 
long  term  (strategic),  gains  are  not  realized.  The  device, 
however,  may  have  use  in  doing  such  things  as  breaking  a guns 
tracking  solution,  or  defeating  the  terminal  maneuvering  of 
an  air-to-air  missile.  Additionally,  it  can  be  seen  that 
the  maximum  benefit  in  this  situation  is  derived  some  15-16 
seconds  after  application,  leading  to  the  conclusion  that 
another  device,  or  maneuver  delivered  in  conjunction  with  the 
first  device,  but  15- *6  seconds  later  may  be  even  more  effec- 
tive. Care  should  be  taken,  however,  to  not  extrapolate  to 
conditions  other  than  those  tested  as  shown  in  figure  26.  In 
figure  26,  the  same  device  is  tested  in  an  initially  neutral 
situation  with  little  or  no  effect  on  the  engagement 
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dynamics  even  though,  the  device  was  used  for  some  12  seconds 
(as  opposed  to  4-5  seconds  in  figure  25) . The  inability  to 
break  out  of  the  neutral  state  (neighborhood  of  PI  = 0)  is 
fairly  typical  in  one  on  one  engagements  for  well  trained 
pilots  in  similar  aircraft,  because  there  is  no  performance 
differential  to  use  to  advantage.  The  device  in  this  case 
did  not  evidently  supply  the  needed  performance  advantage 
under  these  circumstances.  A large  number  of  the  potential 
changes  of  the  air  combat  situation  which  can  be  brought 
about  by  a device  or  a particular  maneuver  are  shown  in 
figure  27.  There  are  obvious  conclusions  to  be  drawn.  For 
example,  a device  which  gives  no  change  in  a particular 
situation  must  have  merit  elsewhere  or  it  is  not  worth  its 
weight  or  cost.  Pure  gain  and  pure  loss  are  obvious,  but 
the  intermediate  cases  of  a combination  of  gains  and  losses 
must  be  examined  more  closely.  A strategic  (long  term)  loss 


may  be  acceptable  if  it  provides  immediate  assistance  in  a 
dire  situation  (tactical  gain) . For  example,  the  data  of 
figure  25  presents  a situation  where  just  such  a combination 
of  events  would  be  tolerated.  It  may  also  be  tolerated  if 
the  tactical  gain  is  large  enough  to  provide  a weapons 
opportunity.  Conversely,  a tactical  loss  may  be  tolerated  if 


a strategic  gain  can  be  achieved,  and  the  tactical  loss  is 


sufficiently  small  or  non-threatening.  The  individual 
conditions  must  determine  where  and  what  magnitude  losses  are 
acceptable. 


> * 
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In  the  test  cycle,  care  should  be  taken  that  the 
evolution  of  counter- tactics  and  counter-counter- tactics  do 
not  alter  the  basic  conclusions  as  to  the  usefulness  of  the 
device.  For  this  reason,  the  analysis  of  individual  engage- 
ments should  be  done  in  conjunction  with  an  evaluation  of 
multiple  engagements. 


MULTIPLE  ENGAGEMENTS 
Data  Set  Definition 

The  analysis  of  multiple  engagements  is  undertaken  to 
ascertain  the  repeatability  of  a given  set  of  data  and  to 
determine  measures  of  effectiveness  which  can  be  used  to 
make  decisions  about  tactics,  hardware,  or  general  philosophy 
of  engagement.  The  first  step  in  the  analysis  is  to  define 
the  engagement  set  as  a whole.  The  following  paragraph 
describes  the  engagement  set  shown  in  figure  17  of  Chapter  4. 

The  data  set  is  defined  by  a collection  of  33  engage- 
ments of  two  fighter  aircraft  versus  one  adversary  aircraft. 
The  fighter  aircraft  were  of  the  large  (heavy  weight) , high 
thrust  class  with  full  weapons  systems  (including  on-board 
radar) . The  adversary  aircraft  were  of  the  small  highly 
maneuverable  type  of  a moderate  thrust  class  with  a moderate 
weapons  system  (no  onboard  radar) . All  engagements  were 
started  with  a neutral  (qualitative)  initial  condition,  and 
duration  ranged  from  just  over  one  minute  to  just  under  five 
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minutes.  Tactics  employed  were  predominatly  the  presentation 

i 

of  one  of  the  fighters  as  a target  to  entice  the  advesary  to 
a vulnerable  position  with  heavy  use  of  free  fighter/engaged 
fighter,  but  training  rules  forbade  the  slashing  attack  (high 
energy  fight) , and  all  combatants  were  required  to  "mix  it 
up  and  turn  with  the  advesary."  Vectoring  information  (GCI) 
was  supplied  to  all  combatants  (fighters  or  advesaries)  for 
initial  run-in.  The  GCI  information  was  designed  to  set  up  a 
head  on  intercept  at  five  natucial  miles.  Inside  five  nauti- 
cal miles,  or  after  first  visual  identification  (VID)  no 
further  GCI  assistance  was  given.  The  engagements  were 
allowed  to  continue  without  consideration  of  weapons  envelopes 
until  both  combatants  decided  to  break-off  or  a safety  vio- 
lation occurred  (such  as  low  altitude  or  outside  of  range 
boundaries) . 

Analysis  of  the  individual  engagements  has  determined  I' 

that  in  17  of  33  engagements,  the  fighters  had  radar  contacts 
prior  to  termination  of  GCI,  providing  an  informational 
advantage.  Despite  this  informational  advantage,  first  tally 
was  achieved  about  equally  by  fighters  and  adversaries. 

Additionally,  the  fighters  were  nearly  always  at  a higher 
speed  on  ingress  giving  them  a slight  energy  advantage.  Each 
engagement  was  considered  to  numerically  begin  with  the  first 
tally  (either  pilot  or  RIO,  fighter  or  adversary) . 
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Data  Set  Characterization 

f 

The  data  set  characterization  is  by  the  methodology 
presented  in  Chapter  4.  Figure  28  is  the  distributional  data 
for  the  initial  starts  of  the  thirty-three  engagements  and 
shows  that  the  entire  data  set  comprised  a neutral  start  (±40 
in  performance  index  value)  with  a near  normal  distribution 
about  the  mean  (6.34).  Table  6 presents  the  characterization 
of  the  full  data  set  in  terms  of  their  statistical  attributes. 

The  low  value  of  the  third  moment  at  the  initial  condition 
verifies  the  near  normality  of  the  data  set  start.  Figure  29 
shows  the  frequency  fit  data  at  one  second  intervals  for  the 
entire  data  set. 

Analysis  of  the  Data  Set  Characterization 

Figure  29  offers  potential  for  detailed  analysis  of 
the  engagement  set  as  a whole.  The  initial  drop  off  in  the 
frequency  value  indicates  a sharp  increase  in  the  randomness  i ' 

4 

of  events.  This  would  indicate  that  the  choice  of  time  for 
the  initial  starts  coincided  very  closely  to  the  initial 
offensive  and  defensive  maneuvering.  The  peak  of  the  curve, 
or  the  highest  naturally  occurring  frequency  stays  near  the 
0 performance  index  indicating  that  the  two  heavier  fighters 


An  increase  in  the  randomness  of  events  is  taken  to  mean  a 
decrease  in  the  difference  of  probability  of  occurrence  of 
any  range  of  performance  index  values  — that  is  the 
tendency  toward  a uniform  distribution  which  has,  at  every 
equal  interval,  the  same  probability  of  occurrence  and  at 
every  value  the  same  frequency  of  occurrence. 
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against  the  one  lighter  adversary  is  a fairly  equal  match-up. 
This  is  further  demonstrated  by  the  mean  value  as  shown  in 
table  6 which  attains  an  absolute  value  no  greater  than  16.13 
which  is  still  well  within  the  zone  considered  neutral.  This 
is  also  indicated  in  the  rapid  drop-off  in  the  peak  of  the 
frequency  curve  with  time.  If  one  aircraft  section  had  totally 
dominated  the  other,  a shift  in  the  value  of  the  performance 
index  at  the  peak  with  little  drop-off  in  the  frequency 
would  be  expected. 

The  decrease  in  peak  frequency  (increase  in  random 
events)  continues  throughout  time  as  demonstrated  by  figure 
30  which  shows  the  degradation  to  a near  uniform  distribution, 
but  with  what  non-uniformity  there  is  skewed  in  favor  of  the 
adversary  aircraft.  This  advantage  to  the  adversary  is  dem- 
onstrated in  figure  29  by  viewing  the  frequency  value  in  time 
along  the  -100  axis  of  performance  index  (optimal  weapons 
delivery  for  the  adversary) . These  values  are  cross-plotted 
in  Figure  33.  The  frequency  of  occurrence  of  the  optimal 
position  for  the  underlying  distribution  is  immeasureably 
small  until  some  70  seconds  into  the  engagement.  At  this 
point,  the  frequency  of  occurrence  increases  in  magnitude 
with  time  (with  some  oscillations) . Examination  of  the  +100 
axis  of  performance  index  (optimal  weapons  delivery  for  the 
fighter  section)  can  be  analyzed  by  figure  31.  These  values 
are  cross-plotted  in  Figure  34.  In  figure  31  it  is  shown 
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that  measurable  frequencies  occur  much  earlier  in  the  engage-  , 

ment  (10-30  seconds)  indicating  an  early  advantage  for  the 
fighter  section.  Although  measureable  frequencies  are 
present  after  70  seconds,  they  do  not  rise  dramatically  as 
in  the  case  of  the  adversaries. 

• These  items  can  be  better  illustrated  by  the  use  of 
figure  32.  Figure  32  is  a contour  plotting  of  the  three 
dimensional  figure  shown  in  figures  29  and  31.  The  contours 
are  taken  at  6.001  intervals  in  the  frequency  values.  The 
figure  is  generated  by  cutting  figure  29  with  planes  parallel 
to  the  base  plane.  The  lines  then,  represent  constant 
frequency  at  0.001  intervals.  In  moving  from  either  the 
upper  left  or  lower  left  corner,  to  the  center  right  of  the 
figure  the  first  curve  encountered  is  a frequency  of  0.001 
the  second  curve  is  0.002,  etc.  A dramatic  demonstration  of 
the  difference  between  the  early  time  of  the  engagement  set 
and  later  time  is  shown  by  noting  that  the  frequency  value  of 
0.001  first  occurs  at  about  20  seconds  for  the  optimal  weapons 

i 

delivery  for  the  fighter  section  (where  the  0.001  curve  inter- 
sects 4-100  in  performance  index) , but  is  delayed  to  around 
84  seconds  for  the  optimal  weapons  delivery  for  the  adversary 
(where  the  0.001  curve  intercepts  -100  in  performance  index). 

In  constrast,  the  frequency  value  of  0.002  first  occurs  at 
about  157  seconds  for  the  adversary  (where  0.002  intersects 
-100  in  performance  index) , but  does  not  occur  in  the  data 


FREQUENCY  PI  CONTOURS 
EVERY  0.001  IN  FREQUENCY 


FIG.  32:  FREQUENCY  CONTOURS 
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set  for  the  fighter  section  (0.002  does  not  intersect  +100 
in  performance  index) . The  figure  can  also  be  used  to  show 
the  variation  in  the  peak  frequency  location  with  time  by, 
tracing  the  highest  naturally  occurring  frequency  (the 
smallest  closed  figures)  in  time.  It  can  be  seen  that  this 
moves  first  in  favor  of  the  fighter  section  (more  positive 
PI)  and  later  moving  in  favor  of  the  adversary,  finally 
crossing  PI  = 0 at  about  90  seconds.  Table  7 gives  the 
numeric  values  of  performance  index  at  peak  frequency  at  5 
seconds  intervals.  The  radical  dropoff  in  peak  frequency  is 
also  apparent.  For  comparison,  a uniform  distribution  over 
the  interval  <+100,  -100>  would  have  a constant  value  of 
0.005. 

Figures  33  and  34  show  contours  taken  at  positive  and 
negative  performance  index  values  respectively.  These 
figures  tend  to  reinforce  the  points  previously  stated.  For 
example,  the  radical  drop-off  in  frequency  in  time  of  the 
initial  portion  of  the  engagement.  The  long  term  drop-off  in 
the  frequency  of  the  neutral  values  (±20  in  performance  index) , 
and  the  long  term  rise  in  weapon  opportunities  (-80  to  -100 
for  the  adversary,  and  +80  to  +100  for  the  fighter  section) 
is  a natural,  expected,  and  believable  outcome.  The  figures 
also  point  out  the  major  trend  reversal  which  occurs  at  about 
50  seconds,  where  the  incidence  of  neutral  increases  and  the 
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PERFORMANCE  INDEX  VALUES  AT  PEAK  FREQUENCY  (Mode) 


Time  (sec)  Performance  Index  (rounded)  Peak  Frequency 


1 

6 

.03991 

6 

16 

.02034 

11 

24 

.01190 

16 

28 

.00997 

21 

22 

.00887 

26 

22 

.00907 

31 

9 

.00936 

36 

9 

.00976 

41 

10 

.01162 

46 

12 

.01115 

51 

12 

.01309 

56 

0 

.01238 

61 

0 

.01229 

66 

5 

.01043 

71 

14 

.00895 

76 

12 

.00827 

81 

18 

.00854 

86 

10 

.00701 

91 

2 

.00734 

96 

-15 

.00888 

101 

-17 

.00857 

106 

-22 

.00941 

111 

13 

.00800 

116 

-14 

.00790 

121 

-28 

.00931 

126 

-16 

.00846 

131 

-10 

.00796 

136 

-5 

.00780 

141 

-12 

.00830 

146 

-12 

.00786 

151 

-18 

.00937 

156 

-18 

.00875 

161 

-16 

.00731 

166 

-23 

.00757 

171 

-25 

.00743 

176 

-28 

.00796 

181 

-26 

.00717 
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weapon  opportunities  fall  to  near-zero.  These  would  tend  to 
suggest  a lull  in  the  activity  of  the  pursuit  game,  but  is  as 
of  yet  unexplained. 

SUMMARY  ANALYSIS  OF  MULTIPLE  ENGAGEMENTS 

The  data  set,  thus  characterized,  can  be  summarized  as 
initially  neutral  with  an  immediate  swing  in  favor  of  the 
fighter  section.  This  is  lost  at  some  time  later  in  the 
engagement  (around  90  seconds)  to  the  more  maneuvered) le 
adversary.  The  initial  swing  in  favor  of  the  fighter  is  the 
outcome  of  the  informational  (onboard  radar)  and  energy 
advantages.  The  informational  advantage  disappears  very 
quickly  with  the  aircraft  moving  into  the  visual  arena,  and 
the  energy  advantage  disappears  more  slowly,  but  just  as 
surely  in  the  turning  with  the  more  maneuverable  bogey.  As 

i 

these  two  advantages  disappear,  and  section  coordination 
breaks  down,  the  bogey  is  selectively  engaging  the  most 
vulnerable  fighter.  The  early  advantage  is  extremely  impor- 

► 

tant  to  the  fighter  section  in  that  it  will  get  the  largest 
number  of  early  shot  opportunities  and  thus  terminate  those 
engagements  quickly.  This  suggests  an  early  aggressive  ap- 
proach by  the  fighter  section.  The  long  term  loss  is  signi- 
ficant in  that  the  point  at  which  a decision  must  be  made  to 

j 

( continue  or  break  off  the  engagement  can  be  identified  (around 

90  seconds).  For  the  adversary,  of  course,  the  analysis  is 
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different.  It  must  be  his  job  to  minimize  the  effect  of  the 
early  informational  advantage,  and  negate  the  energy  advantage 
as  quickly  as  possible.  He  must  additionally  survive  the 
early  portion  of  the  engagement  to  take  advantage  of  later 
opportunities.  This  suggests  an  early  conservative  approach 
for  the  adversary. 

If  these  suggestions  cause  changes  in  the  tactical 
approach  to  the  engagement,  then,  of  course,  the  engagement 
set  should  be  retested  to  make  certain  that  outcomes  are  not 
altered. 

THE  DEVELOPMENT  OF  MEASURES  OF  EFFECTIVENESS 

Because  of  the  large  number  of  considerations,  and  the 
extreme  number  of  computations  and  available  numbers,  it  is 
important  to  develop  reasonable  measures  of  effectiveness  (MOE) 
which  reflect  the  above  analyses.  The  tendancy  in  most 
analyses  involving  statistical  data  is  to  examine  the  central 
measures  (expected  values)  such  as  mean,  mode,  median,  etc. 
Several  of  these  have  been  previously  examined,  and  as  shown 
in  tables  6 and  7,  these  do  offer  some  of  the  analysis 
information  available.  For  example,  in  table  6 and  figure  35 
the  mean  value  changes  sign  at  around  90  seconds  this  also 
represents  a transition  in  the  value  of  the  mode  (table  7) . 

Vhis  time  was  previously  identified  as  the  point  at  which  the 
fighter  section  loses  its  initial  benefit. 
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These  central  measures,  however,  are  of  lesser  benefit 
because  they  are  well  within  the  neutral  values  of  performance 
index  values,  and  hence  it  is  hard  to  assign  engagement  out- 
come significance  to  them.  The  really  significant  measures 
occur  in  the  outer  or  limiting  values  of  the  performance 
index  which  represent  the  weapons  envelope  data.  These 
values  can  be  related  directly  to  the  terminal  phases  of  the 
engagement.  These  measures  can  also  be  used  for  direct 
comparison  in  data  sets. 

The  first  step  in  the  computation  of  these  measures 
is  to  define  an  area  of  interest.  This  region  should 
correspond  roughly  to  the  weapons  carried  by  the  aircraft 
and  may  in  general  be  indicative  of  but  not  directly  related 
to  weapons  envelope.  The  values  chosen  for  this  analysis 
were  taken  arbitrarily  as  80  to  100  for  both  the  fighter 
(positive  PI)  and  adversary  (negative  PI) . The  value  chosen 
may  in  general  be  different  for  the  given  combatants.  For 
example,  if  an  F-4  with  AIM-9H  weapons  were  engaging  a 
MIG- 15  with  only  short  range  guns,  the  values  of  interest 
might  be  70  to  100  for  the  fighters  and  90  to  100  for  the 
adversary.  Chosing  the  same  region  for  fighters  and  adversary 
, is  equivalent  to  stating  that  the  weapons  have  similar 

capability. 

These  value  ranges  represent  the  tails  of  the  distribu- 
tional  data  (see  figure  30) . By  integrating  the  density 
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value  over  this  range,  a probability  that  the  value  lies  in 
the  region  of  interest  is  obtained  as  detailed  in  Chapter  4. 
This  probability  taken  over  a unit  time  value  represents  the 
expected  time  of  occurrence  of  this  range  of  values  of  the 
distribution  in  that  time  increment.  This  is  then  integrated 
over  time  to  give  a cumulative  time  in  the  region  of  interest 
as  shown  in  figure  36.  If  the  region  of  interest  is  the 
weapons  envelope,  then  the  integrated  value  represents  a 
cumulative  weapons  envelope  time  as  a function  of  time.  The 
difference  between  the  fighter  sections  expected  time  accumu- 
lation and  the  adversary  time  accumulation  will  then  yield 
the  measures  of  effectiveness  as  shown  in  figure  37. 

As  shown  in  figure  37,  the  fighter  section  accumulates 

more  weapons  envelope  time  than  the  adversary  over  the  first 

89  seconds  of  the  engagement.  This  region  has  been  labeled 

as  fighter  section  dominance  and  can  be  quantified  by  either 

the  integral  of  the  function  (area  under  the  curve-in  this 

2 

case  approx  44.5  sec  ) or  by  noting  in  figure  36,  that  there 
is  some  time  lag  between  the  fighters  accumulation  of 
envelope  time  and  the  bogeys.  This  would  be  represented  by 
the  area  between  the  two  curves  over  the  first  89  seconds 
(same  value) . The  peak  of  the  curve  is  labeled  the  tactical 
decision  point  and  represents  the  point  at  which  a decision 
to  pursue  the  engagement  or  BUGOUT  should  be  made.  The 
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FIG.  37:  CUMULATIVE  ADVANTAGE  PLOT 
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The  final  measure  given  by  figure  37  is  the  point  at  which 
the  early  advantage  is  completely  dissipated  by  the  adversary. 
This  is  labeled  the  advantage  loss  point  and  occurs  some  174 
seconds  into  the  engagement  for  the  sample  data  set.  These 
measures  can  then  be  used  to  describe  the  engagement  set  using 
fewer  numbers  for  analyses.  Chapter  6 will  present  a specific 
example  of  their  use. 


CHAPTER  6 


THE  SENSITIVITY  OF  ENGAGEMENTS  TO 
SMALL  CHANGES  IN  INITIAL  CONDITIONS 

"The  purpose  of  computing  is  insight , not  numbers." 

--  R. W.  Hamming 


METHOD  OF  ANALYSIS 

The  data  set  presented  in  Chapter  4,  figure  17  was 
analyzed  to  ascertain  the  sensitivity  of  air  combat  engage- 
ments to  small  changes  in  initial  conditions.  With  the 
performance  index,  neutral  is  given  by  a value  of  0.0  giving 
easy  numerical  definition  to  small  changes  in  the  initial 
start.  The  analysis  method  employed  was  to  fractionate  the 
data  set  and  then  proceed  with  the  computation  of  the  mea- 
sures of  effectiveness  described  in  Chapter  5.  The  boundaries 
of  fractionation  were  chosen  to  yield  a workable  data  set, 
and  complementary  sets  were  not  available  in  each  instance, 
so  that  complementary  sets  were  not  examined.  Figure  28  of 
Chapter  5 gives  the  distribution  of  initial  starts.  It  can 
be  seen  that  the  entire  data  set  comprises  a neutral  start 
with  mean  value  PI  equal  to  6.34  (table  6)  and  standard 
deviation  of  10.69  (square  root  of  variance  table  6). 

Figures  29  and  31  show  the  stochastic  representation  of  the 
full  data  set  taken  as  the  representative  density  function 
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in  time.  The  data  set  was  then  fractionated  according  to  two 
criteria: 

• Initial  engagement  start  as  shown  in  table  8. 

• Initial  engagement  trend  as  shown  in  table  9. 

In  the  former,  two  measures  of  effectiveness  were  used 
in  the  analysis: 

• The  tactical  decision  point  (the  point  at  which 

fighter  dominance  was  lost) . 

• The  advantage  loss  point. 

These  measures  were  computed  by  accumulating  expected  values 
of  weapons  envelope  time.  The  weapons  envelope  time  was 
computed  via  a double  integration  of  the  density  function  in 
the  applicable  region  of  weapons  delivery  as  described  in 
Chapter  5.  Figure  37  shows  the  cumulative  advantage  plot 
for  the  baseline  case  indicating  both  measures  of  effectiveness. 

In  the  latter  case,  these  measures  of  effectiveness  were 
used,  and  one  additional  measure  was  added  to  account  for  the 
magnitude  of  the  fighter  dominance  in  the  opening  period  of 
the  engagement.  The  measure  was  taken  as  the  time  it  takes 
the  adversary  to  reach  10%  of  the  value  of  expected  envelope 
time  that  the  fighter  section  has  accumulated.  This  number 
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TABLE  8 

DATA  SET  FRACTIONATION 
INITIAL  START 


Criteria 

Number  of  Engagements 

Description 

+5  to  -100 

15 

disadvantaged 

+100  to  0 

27 

advantaged 

+ 100  to  -100 

33 

base  line 

+10  to  -10 

20 

neutral 

+5  to  -5 

13 

tight  neutral 

Criteria 

Positive  PI  slope 
1st  6 points 

Positive  PI  slope 
1st  4 points 

Positive  PI  slope 
1st  2 points 

All  engagements 
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TABLE  9 

DATA  SET  FRACTIONATION 
ENGAGEMENT  TREND 

Number  of  Engagements 

Description 

15 

Heavily  favored 
trend 

20 

Moderately  favored 
trend 

22 

Lightly  favored 
trend 

33 

Baseline 
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represents  the  time  it  takes  the  adversary  to  recover  from 
the  initial  engagement  trend. 

INITIAL  START  ANALYSIS 

The  measures  of  effectiveness  for  the  fractionated 
data  sets  listed  in  table  8 are  presented  in  table  10.  Small 
changes  in  the  initial  conditions  were  obtained,  by  deleting 
engagements  from  the  data  set.  As  shown  in  table  10  to  get 
from  the  base  case  to  the  advantaged  case,  four  engagements 
were  dropped  because  their  initial  performance  index  value 
was  negative.  The  effect  on  the  distributional  data  was  to 
increase  the  mean  value  of  the  initial  performance  index  to 
9.33  from  6.34  giving  a quantitative  shift  of  2.99.  Each  of 
the  data  sets  presented,  approximated  a near  normal  initial 
condition  with  mean  value  as  presented  in  table  10.  In  the 
instances  of  the  disadvantaged  and  tight  neutral  starts,  not 
enough  data  remained  to  carry  the  computation  all  the  way  to 
the  advantage  loss  point.  Table  10  indicates  a very  low 

> 

sensitivity  to  small  changes  in  initial  starts  in  both  the 
tactical  decision  point  and  the  advantage  loss  point. 

Specifically,  the  flat  slope  in  the  neighborhood  of  the 
tactical  decision  point  (see  figure  37)  negates  the  differences 
shown  in  table  10,  while  the  advantage  loss  point  is  within 
4 percent  where  there  is  sufficient  data  to  compute  the  fig- 
ure. This  lack  of  sensitivity  to  small  changes  in  the 
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neighborhood  of  neutral  is  surprising  in  that  it  indicates 
that  a large  change  is  needed  to  affect  engagement  outcomes 
when  they  are  started  from  an  initially  neutral  condition. 

This  conclusion,  of  course,  must  be  limited  to  the  aircraft, 
tactics,  and  pilot  proficiency  levels  embodied  in  the  test 
sample,  and  to  the  near  neighborhood  of  a neutral  start.  It 
was  shown  in  Chapter  5 that  in  radically  different  initial 
conditions  conclusions  may  be  altered. 

ENGAGEMENT  TREND  ANALYSIS 

The  measures  of  effectiveness  for  the  fractionated 
data  sets  listed  in  table  9 are  presented  in  table  11. 

Changes  in  engagement  trend  at  the  initial  onset  of  the 
analysis  (first  tally)  were  obtained  by  deleting  those  en- 
gagements which  did  not  meet  the  criteria  for  a positive 
upward  slope  on  the  performance  index  measure  over  a given 
number  of  data  points.  Only  one  of  the  data  sets  iraction- 

: 

ated  this  way  showed  a cross-correlation  with  initial  start 
as  indicated  by  the  mean  initial  PI  value  in  column  four  of 
table  11.  It  can  be  noted  that  the  positive  engagement 
trend  radically  shifts  forward  the  tactical  decision  point. 

This  would  correlate  well  with  the  pilot  recognition  of  a 
developing  trend,  and  the  subsequent  much  harder  engagement 
being  pursued  by  the  fighter  aircraft  to  convert  to  a quick 
victory.  This  level  of  effort  seems  almost  binary  in  that 
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the  tactical  decision  point  is  invariant  when  any  favorable 
trend  is  isolated.  The  harder  fight,  of  course,  causes  a 
much  quicker  depletion  in  fighter  energy  which  gives  a quicker 
emphasis  to  the  adversary  maneuverability  and  hence  the 
earlier  tactical  decision  point.  The  forward  shift  in  the 
tactical  decision  point  is  a direct  consequence  of  the  earlier 
engagement  dominance  as  seen  by  the  time  before  the  adversary 
begins  to  accumulate  significant  weapons  envelope  time.  The 
counter-trend  to  this  noted  in  the  moderately  favored  trend  is 
discounted  for  two  reasons.  The  first  is  that  the  slope  of 
the  cumulative  advantage  plot  is  very  shallow  over  the  first 
few  seconds  of  the  engagement  set  as  shown  by  figure  37. 

Secondly,  the  large  shift  in  the  mean  initial  performance 
index  value  may  make  this  data  subject  to  cross-correlation 
effects  which  have  not  been  explored  because  of  the  limits  of 
sample  size. 

SENSITIVITY  SUMMARY 

The  engagements  analyzed  would  indicate  that  in  the 
two-versus-one  air  combat  arena,  the  initial  engagement 
position  is  much  less  significant  than  the  engagement  trend. 

The  latter,  while  decreasing  the  time  before  encountering  the 

i 

tactical  decision  point,  offers  a greater  degree  of  engagement 
dominance  in  the  earlier  portion  of  the  engagement,  and 
hence,  the  possibility  of  greater  attrition  of  the  adversary. 
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The  former  appears  to  have  little  or  no  effect  on  the  mea- 
sures of  effectiveness  for  small  changes  in  the  near- 
neighborhood of  neutral. 
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SUMMARY 

"I  know  you  think  you  understood  what  I said,  but  I am  not 
sure  you  understand  that  what  I said  was  not  what  I meant.  " 

--  Anonymous 

THE  ANALYSIS  APPROACH 

It  has  been  shown  that  for  many  system  interactions, 
and  specifically  for  the  example  shown,  the  deterministic  view 
is  unacceptable  when  compared  with  experimental  results. 

Statistical  descriptors  as  to  the  outcome  of  such  interactions, 
while  useful,  are  less  pleasing  than  statements  about  the 
form  and  substance  of  the  interaction.  Details  in  the  form 
of  statistical  descriptors  of  the  interaction  can  be  made  if 
the  priorities  and  goals  are  well  enough  defined  to  do  merit 
ordering  (the  development  of  a figure  of  merit) . These  can 
further  be  developed  into  measures  of  effectiveness  which 
might  describe  a group  of  interactions.  Specifically,  the 
following  actions  must  be  taken  in  order  to  achieve  this  set  > 

of  descriptors. 

• The  definition  of  the  problems  in  terms  of  its 
history,  goals,  and  priorities.  (Chapter  2 for 
the  example  set. ) 
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• The  development  of  a figure  of  merit  i 

describing  these  goals  and  priorities.  (Chapter  3 

for  the  example  set  — a general  definition  set 
for  the  arbitrary  system  interaction  can  be 
found  in  Wymore  (reference  32)  which  describes 
a system-theory  analysis  of  large  scale  man/ 
machine  systems  interfaces.) 

• The  careful  definition  of  statistical  tools 
to  be  used  as  descriptors.  (Chapter  4 for  the 
example  set.) 

• The  development  of  measures  of  effectiveness. 

(Chapter  5 for  the  example  set.) 

FOLLOW  ON  WORK 

The  development  of  analytic  tools  for  the  characteriza- 
tion and  analysis  of  experimental  data  has  been  shown.  While 
the  characterization  of  experimental  data  is  useful  in  the 

* 

analysis  of  engagement  trials,  it  can  also  be  used  in  the 
development  of  a cause/effect  relationship  for  the  extrapola- 
tion of  data  to  situations  not  tested  or  not  testable.  Such 
a predictor  model  would  be  "real-world"  and  involve  multi- 
aircraft air  combat  as  well  as  the  incorporation  of  actual 
flight  test  data  which  few  models  presently  do.  Figure  38 
shows  the  basic  construction  of  such  a predictor  model  as 


STATISTICAL  V 
CHARACTERIZED 
PERFORMANCE 
DATA 
I CAUSE ) 


STATISTICALLY 
CHARACTERIZED 
TEST  OATA 
(EFFECT* 


FIG.  38:  STOCHASTIC  MODEL  ACM  PEETFORMANCE  PREDICTOR 


applied  to  the  example  case  under  consideration.  The  main 
requirement  is  in  the  creation  of  two  identically  structured 
but  independently  executed  data  sets.  The  first  of  these, 
would  be  used  to  create  independently  generated  cause  and 
effect  data  as  shown.  These  cause  and  effect  data  will  then 
be  used  to  generate  a mathematical  relationship  through  one 
of  the  many  available  mathematical  tools.  This  relationship 
together  with  the  required  input  assumptions  will  be  used  to 
predict  the  statistically  characterized  outcomes  of  the 
second  data  set.  The  input  assumptions  and  mathematical 
relations  will  then  be  adjusted  until  adequate  prediction  is 
achieved.  Table  12  presents  the  basic  types  of  assumptions 
required  by  the  proposed  model  in  comparison  to  present 
models.  The  most  significant  assumptions  which  are  relaxed, 
are  those  of  the  perfect  information  and  perfect  pilot  as 
discussed  in  Chapters  1-3. 


AREAS  OF  APPLICATION 

For  the  example  data  set,  the  analysis  method  has 
direct  application  in  several  areas  including;  aircraft 
design,  test  and  evaluation,  pilot  training  and  proficiency, 
force  strength  projections,  etc.  Some  specific  examples 


follow: 
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TABLE  12 

COMPARISON  OF  PREDICTOR  TYPES 
(ASSUMPTIONS  REQUIRED) 


Digital  Simulation 

(TACTICS  II,  NORTAC,  Decision 
Sciences,  etc.) 

1.  Deterministic 

2.  Finite  dimensional 

3.  Finite  response 

4.  Tactics  oriented 

5.  Perfect  information 

6.  Perfect  pilot 


Manned  Simulation 
Flight  Test 

(Stochastic  Test  Model) 

1.  Non-deterministic 

2.  Finite  dimensional 

3.  Infinite  response 

4.  No  operational  assump 
tions  required 
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• Pilot  Training — Applications  to  training  can  > 

be  made  in  the  area  of  multiaircraft  fighter  sec- 
tion coordination  and  the  identification  of  . 

critical  points  in  the  engagement,  as  given  in 
Chapter  5.  These  figures  can  be  used  as  measures 
of  proficiency  for  pilot/wingman  combinations  or 
fighter  squadron  readiness  as  compared  to  an 
established  criterion. 

• Aircraft  and  Armament  Design — The  direct  appli- 
cation of  performance  index  data  to  the  design 
problem  can  be  achieved  by  determining  the 
sensitivity  of  engagement  outcomes  to  variables 
under  the  control  of  the  designer,  through  either 

a predictor  model  or  a direct  test  of  concepts. 

• Operational  Planning — Estimated  force  strength 
requirements  are  a direct  fallout  of  the  predictor 
model  as  discussed.  Air  superiority  force 
strengths  can  be  based  on  realistic  projections 

of  fighter  aircraft  attrition  in  air  combat 
maneuvering . 

e Weapon  System  Effectiveness— The  performance 
index  method  can  be  used  as  a measure  of  total 
system  effectiveness  in  fighter  aircraft  test  and 
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evaluation.  The  mission  systems  effectiveness  r 

for  the  fighter  mission  would  be  given  as  the 
set  of  engagement  outcomes. 

f 

• Airplane  System  Test  and  Evaluation — Individual 
hardware  (maneuvering  flaps,  thrust  reversers, 
etc.)  can  be  tested  by  its  ability  to  change  the 
performance  index  distribution  in  a given  set  of 
tests  as  shown  in  Chapter  5. 
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APPENDIX  A 

LIST  OF  SYMBOLS  AND  ABBREVIATIONS 


aij 

AA 

ACEl 

ACEVAL 

ACM 

ACM  I 

ACMR 

ACMRDB 

AIS 

ALT 

ADA 

AOT 

ATA 

BINGO 

BUGOUT 

c 

CCS 

CRTREC 

6 


Squared  difference  terns 

Angular  Advantage 

Program  for  Statistical  Analysis 

Air  Combat  Evaluation 

Air  Combat  Maneuvering 

Air  Combat  Maneuvering  Instrumentation 

Air  Combat  Maneuvering  Range 

Driver  Program  to  Produce  Cumulative  Engagement 
Tapes  From  ACMR  Tapes 

Airborne  Instrumentation  Subsystem 

Altitude 

Angle  of  Attack 

Angle  Off  Tail 

Antenna  Train  Analge 

Low  Fuel  State,  or  Prebriefed  Fuel  for  Return 
to  Base 

Engagement  Breakoff  by  One  of  the  Combatant 
Sections 

Proportionality  Constant 
Computation  and  Control  Subsystem 
Control  Subprograms  for  Real-Time  Records 
Empirically  Derived  Constant 
Directional  Angle 
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DEBRIEF 


ENVIND 


FREDIS 


GETOBS 


Subprogreun  to  Read  Debrief  Data 
Display  and  Debriefing  Subsystem 
Subprogram  to  Compute  Envelope  Indications  - 
Differential  Energy 
Natural  Constant  (2.7183) 

Energy  Coefficient 

Specific  Energy 

Average  Specific  Energy 

Frequency 

Figure  of  Merit 

Measured  (computed)  Frequency 

Range  Performance  Penalty  Function 

Interenvelope  Gun  Penalty 

Subprogreun  for  Frequency  Computation 

Fuselage  Reference  Line 

Interenvelope  Gun  Constant 

Subprogreun  to  Read  ACMR  Data  Tapes 

Ground  Control  Intercept 

Weighting  Function 

Subprogreun  to  Compute  Interaircraft  Parameters 
Indicated  Airspeed 
Differential  Energy  Integral 

Kilogreun 

Energy  Influence  Function 
Proportionality  Constant 
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lb 

M 

MOMEN 

MT 

N 

Nz 

P 

PI 

QSF 

R 

RG 

rmax 

HmIN 

ropt 

Ro 

RDEVAL 

SAP 

START 

tally 

t 

TIS 
V 
VC 
VI FF 


Pound 

Sample  Size 

Subprogram  for  Moment  Computation 

Target  Mach  Number 

Newton 

Normal  Acceleration  (load  Factor) 

Probability 
Performance  Index 
Subprogram  for  integration 
Interairplane  Range 

Range  at  which  gun  tactics  begin  to  control  the 
engagement 

Maximum  Range 

Minimum  Range 

Optimum  Range 

Zero  Penalty  Range 

Subprogram  to  Read  Cumulative  Tape  File 

Subprogram  to  Compute  Single  Aircraft  Parameters 

Subprogram  for  Determining  Engagement  Start 
Points 

Visual  Sighting  of  an  Opponent 
Time 

Tracking  Instrumentation  Subsystem 

Velocity  Vector 

Closing  Vector 

Vectoring  in  Forward  Flight 
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X 


Computed  Point  in  Random  Field 
Observed  Random  Data  Point 
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Computed  Point  in  Random  Field 
Relative  Sample  Size 
Exponential  Multiplier  (Empirical) 
Mean  Square  Error 


Subscripts: 

1 

2 

DEF 

OFF 

s 

i 

j 

Total 

N 

Others: 
x (y) 

<a,b> 


Aircraft  Pairing  1 
Aircraft  Pairing  2 
Defensive 
Offensive 
Section 

Aircraft  Pairing  i or  point  i 
Aircraft  Pairing  j or  point/  j 
Total  (time) 

Normalized 


x as  a function  of  y 
Interval 
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APPENDIX  B 


FIGHTER  PERFORMANCE  COMPARISON 
(References  24-26) 
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TABLE  14 
WING  LOADING (1) 


MIG- 17  FRESCO 

43 

lb/ft2 

2058  N/m 

MIG- 19  FARMER 

57 

lb/ft2 

2729  N/m 

MIG- 21  FISHBED 

66 

lb/ft2 

3160  N/m 

MIG- 2 3 FLOGGER 

66(2) 

lb/ft2 

3160  N/m 

MIG- 2 5 FOXBAT 

73  ( 3) 

lb/ft2 

3495  N/m 

F-4  PHANTOM 

73 

lb/ft2 

3495  N/m 

F-8  CRUSADER 

66 

lb/ft2 

3160  N/m 

F-14A  TOMCAT 

48(2) 

lb/ft2 

2298  N/m 

A-4E  SKYHAWK 

49 

lb/ft2 

2346  N/m 

F-5E  TIGER 

72 

lb/ft2 

3447  N/m 

F-106  DART 

45 

lb/ft2 

2154  N/m 

F-15  EAGLE 

54 

lb/ft2 

2585  N/m 

F-18  HORNET 

55 

lb/ft2 

2633  N/m 

Notes:  (1)  At  Combat  Weight 

(2)  Wings  Forward 

(3)  Estimated 


Notes:  (1)  Sea  Level  Full  Afterburner 

(2)  Unavailable  Through  Unclassified  Sources 
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APPENDIX  C 

SUBROUTINE  FOR  THE  COMPUTATION  OF  EMPIRICAL  DISTRIBUTIONS 
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SUBROUTINE  FOR  THE  COMPUTATION  OF  EMPIRICAL  DISTRIBUTIONS 


SUBROUTINE  FREDI S < ALPHA > BETA » DELTA » X . NDATA , FREQ , CUHP . ANS > 

COMMON  FREOCC < 1 86  r 1 0 1 > t XMOM  <18 6?4)t SH0T80  < 1 90 ) t SH0M80  <190) 

COMMON  PIS < 300 r 33) 

DIMENSION  FREQ< 101 ) »CUMP< 101 ) t AN8<4> 

C- 

C-  THI8  SUBROUTINE  USES  FREQUENCY  DISTRIBUTION 

C-  RECOVERY  TECHNIQUE ***  PER  ULTRASYSTEMS  RPT 

C- 

C-  IT  CALLS  AN  INTEGRATION  SUBROUTINE  <QSF>  AND  A MOMENT  CALCULATION 
C-  SUBROUTINE  <MOMEN> 

C- 

C-  THE  DISTRIBUTION  FUNCTION  OF  THE  X STRING  VECTOR  IS  COMPUTED 
C-  AND  PLACED  IN  FREQ  AFTER  IT  IS  NORMALIZED 
C~ 

C-  X HAS  NDATA  VALUES  WITH  A MAXIMUM  OF  BETA  < RANGE  VALUE) 

C-  A MINIMUM  OF  ALPHA  < RANGE  VALUE)  TO  BE  COMPUTED  OVER 
C-  A GRID  VALUE  OF  DELTA 
C- 

C-  THE  PROGRAM  ALSO  RETURNS  THE  NORMALIZED  CUMULATIVE  PROBABILITY 
C-  OF  OCCURENCE  <CUMP>  AND  THE  FIRST  FOUR  MOMENTS  <ANS) 

C- 

DIMENSION  UB0<5)'X<1)'Y<186)'XI<186) 

UB0<1> -ALPHA 
UB0<2)**BETA 
UB0<3)-DELTA 
8UM1-0. 

SUM2-0. 

NPTS- < BETA- ALPHA ) /DELTA+ 1 . 25 
8UMAIJ-0. 

NINT«  < BETA-ALPHA ) /DELTA 
DO  10  I-l» NDATA 
DO  10  J-lf NDATA 

10  SUMAIJ-<X<I)-X<J)>*#2+SUMAIJ 

XMU-O.  I 

XMU-SUMAIJ 

XMU-XMU/ < NDATA*  < NDATA-1 > ) 

IF < ABS < XMU ) • LT < 1 • E-08 ) RHO-O. 

IF  <ABS<XMU) «LT* 1 .E-08)  GO  TO  22 
IF<XMU.GT.l. ) DELTA1-0.010 
XDATA-NDATA  . 

IF<XMU.GT.l.  > RHO*“  < DELT  A 1 * ALOG  < XDATA ) + ALOG  < XMU  ) > /XMU  > 

IF<XMU<LE< 1)  DELTA1-0.250 

IF < XMU . LE . 1 ) RHO-DELTA 1 *ALOG < XDATA ) /XMU 


f 


; 

Jt 

\ 
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22  CONTINUE 
BXNV-O. 

DO  30  I-1»NDATA 
DO  30  J-1»NDATA 

IF((RHO*(X(I)-X( J))**2>.GT.80.)  ECH-O. 
IF((RH0*(X(I)-X(J>)**2).GT.80.)  00  TO  23 
ECH-EXP  < -1 . *RHO* ( X (I ) -X  < J > ) **2 ) 

23  FUNC-(X(I)-X(J>)**2*ECH 
30  BINV-BINV+FUNC 

IF ( ABS (BINV ) • LT 4 1 • E-08)  B-0. 

IF ( ADS ( BINO ) < LT • 1 « E-08 ) 60  TO  32 
BINV"BINV/(NDATA*(NDATA-1 ) ) 

B-l./BINV 
32  CONTINUE 

DO  40  I-lfNPTS 
40  Yd  >“ALPHA+(  1-1  ) 4DELTA 
DO  30  1*1 » NPTS 
FREQ(I>-0. 

DO  50  J-1»NDATA 
STEP1-Y(I>-X(J> 

IF ( ABS ( 8TEP1 *B ) . GT . 12 . > STEP2-0 . 0 
IF ( ABS ( STEP 1*B> . GT. 12. ) GO  TO  50 
8TEP2-EXP ( - 1 * < B*STEP 1 ) **2/2 . > 

50  FREQ( I )*FREQ( I )+B/NDATA*STEP2 
CALL  QSF (DELTA? FREQ • XI «NPTS> 

DO  500  J-l.NPTS 

IF (ABS (XI (NPTS) ) . GT . 1 .E-08)  GO  TO  490 
FREQ(J)-0. 

CUMP(J)-0. 

GO  TO  500 

490  FREQ( J)*FREQ( J)/XI (NPTS) 

CUMP( J)*XI ( J)/XI (NPTS) 

500  CONTINUE 

CALL  MOMEN( FREQ »UBOr NPTS »ANS> 

RETURN 

END 


r 
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SUBROUTINE  FOR  THE  COMPUTATION  OF  INTEGRALS  (Evenly  Spaced) 


SUBROUTINE  QBF(H.Y.Z.NDIM) 

COMMON  FREOCC  < 1 86  » 1 0 1 > . XMOM (186.4). SH0T80  < 190). 8H0M80 ( 190  > 
COMMON  PIS <300. 33) 

THIS  IS  A GENERAL  INTEGRATION  ROUTINE  FOR  EQUALLY  SPACED 
FUNCTIONS  (Y) 

THE  SPACING  OF  Y IS  H THE  NUMBER  OF  POINTS  IS  NDIM 
THE  INTEGRAL  OF  Y IS  Z 


THE  SUBROUTINE  USES  A COMBINATION  OF  8IMPS0NS  RULE 
- AND  NEUTONS  THREE-EIOTH  RULE 


DIMENSION  Y(1).Z(1) 

HT-H81./3. 

1 SUM1-Y<2)4Y<2> 

SUM1-SUM14SUM1 

SUM1 -HT*  < Y ( 1 > 4SUM1 + Y ( 3 ) ) 

AUX1-Y<4)4Y<4> 

AUX1-AUX14AUX1 

AUX1-SUM14HT*<Y(3)4AUX14Y(S) > 

AUX2-HT* ( Y < 1 >43.875*< Y(2)4Y<5>  >42.625*<Y(3)4Y(4>  >4Y(6>  > 
SUM2-Y(5)4Y<5> 

6UM2-SUM24SUM2 

SUM2-AUX2-HT* <Y(4) 4SUM24Y ( 6 > > 

Z<1)»0. 

AUX-Y(3>4Y<3) 

AUX-AUX4AUX 

Z < 2 ) -SUM2-HT  * < Y ( 2 ) 4 AUX4  Y < 4 > > 

Z(3)-8UM1 
Z(4)-SUM2 
IF (NDIM-6)  5.5.2 

2 DO  4 1-7. NDIM. 2 
8UM1-AUX1 
SUM2-AUX2 

AUX1-Y(I-1)4Y(I-1> 

AUX1-AUX14AUX1 

AUX1-8UM14HT*(Y< 1-1 >4AUX14Y< I > > 

Z(I-2)-SUMl 

IF < I-NDIM)  3.6.6 

3 AUX2-Y(I>4Y(I> 

AUX2-AUX24AUX2 
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AUX2“SUM2+HT*<  Y <1-1 )+AUX2+Y( 1 + 1 ) ) 

4 Z(I-1)-SUM2 

5 Z(NDIM-1)-AUX1 
Z<NDIM>«AUX2 
RETURN 

6 Z(NDIM-1)-SUM2 
Z(NDIN)-AUX1 
RETURN 
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f ; 
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SUBROUTINE  FOR  THE  COMPUTATION  OF  CLASSICAL  MOMENTS  (1  to  4) 


SUBROUTINE  MOMEN ( F . UBO . NPTS . ANS ) 

COMMON  FRE0CC( 186. 101 ) .XM0M( 186.4) »SH0T80< 190) .SH0M80(190)  i 

COMMON  PIS (300 *33)  | 

DIMENSION  ANSI 4)  I 

C- 

C-  THIS  ROUTINE  CALCULATES  THE  CLASSICAL  MOMENTS  OF  A GIVEN 

C-  FREQUENCY  FUNCTION  (F)  HAVING  A MAX  <UB0<2>>  A MIN  (UB0(1>>  i 

C-  AND  A GRID  SIZE<UB0<3>)  THE  MOMENTS  ARE  PLACED  IN  ANS  < 

c-  1 

C-  THE  FIRST  MOMENT  <MEAN  IS  ABOUT  THE  ORIGIN) 

C-  ALL  SUBSEQUENT  MOMENTS  ARE  ABOUT  THE  MEAN  I 

c- 

DIMENSION  F(1)»XM<186>»Y(186>  J 

DIMENSION  UB0(3)  i 

DO  10  1*1 .4 
10  ANS(I)*0. 

DO  20  1*1 .NPTS 
y<I)-UB0<l)+<I-l>*UB0<3> 

20  XM(I)-Y(I)*F(I)  i 

CALL  QSF  < UBO  < 3 ) . XM . XM  > NPTS ) 

ANS<1)=XM<NPTS) 

DO  30  1*1 .NPTS 


30 


2 


M<I)=F<I)*<Y<I>-ANS<1)>**2 
ALL  QSF (UB0(3) .XM.XM.NPTS) 


ANS<2)=XM<NPTS) 

DO  40  1*1. NPTS 

40  XM(I)-F<I)*(Y(I)-ANS(1))**3 
CALL  ClSF  ( UBO  ( 3 ) . XM » XM » NPTS ) 
ANS<3)=XM<NPTS) 

DO  50  1=1. NPTS 

50  XM(I)-F(I)*<Y<I)-ANS(1))**4 
CALL  QSF (UB0(3).XM.XM.NPTS> 
ANS ( 4 ) *XM ( NPTS ) 

RETURN 

END 


* 


